-- Logs begin at Thu 2021-09-02 16:25:49 UTC, end at Thu 2021-09-02 17:26:06 UTC. -- Sep 02 16:59:52.991758 dv-cinder-806260-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 02 16:59:53.005258 dv-cinder-806260-3-iscsi devstack@n-api.service[93397]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 02 16:59:53.008312 dv-cinder-806260-3-iscsi devstack@n-api.service[93397]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 2 16:59:53 2021] *** Sep 02 16:59:53.008312 dv-cinder-806260-3-iscsi devstack@n-api.service[93397]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 02 16:59:53.008312 dv-cinder-806260-3-iscsi devstack@n-api.service[93397]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 02 16:59:53.008312 dv-cinder-806260-3-iscsi devstack@n-api.service[93397]: nodename: dv-cinder-806260-3-iscsi Sep 02 16:59:53.008312 dv-cinder-806260-3-iscsi devstack@n-api.service[93397]: machine: x86_64 Sep 02 16:59:53.008312 dv-cinder-806260-3-iscsi devstack@n-api.service[93397]: clock source: unix Sep 02 16:59:53.008312 dv-cinder-806260-3-iscsi devstack@n-api.service[93397]: pcre jit disabled Sep 02 16:59:53.008312 dv-cinder-806260-3-iscsi devstack@n-api.service[93397]: detected number of CPU cores: 4 Sep 02 16:59:53.008312 dv-cinder-806260-3-iscsi devstack@n-api.service[93397]: current working directory: / Sep 02 16:59:53.009300 dv-cinder-806260-3-iscsi devstack@n-api.service[93397]: detected binary path: /usr/bin/uwsgi-core Sep 02 16:59:53.009300 dv-cinder-806260-3-iscsi devstack@n-api.service[93397]: your processes number limit is 47680 Sep 02 16:59:53.009300 dv-cinder-806260-3-iscsi devstack@n-api.service[93397]: your memory page size is 4096 bytes Sep 02 16:59:53.009300 dv-cinder-806260-3-iscsi devstack@n-api.service[93397]: detected max file descriptor number: 2048 Sep 02 16:59:53.009300 dv-cinder-806260-3-iscsi devstack@n-api.service[93397]: lock engine: pthread robust mutexes Sep 02 16:59:53.009300 dv-cinder-806260-3-iscsi devstack@n-api.service[93397]: thunder lock: enabled Sep 02 16:59:53.009300 dv-cinder-806260-3-iscsi devstack@n-api.service[93397]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 02 16:59:53.009300 dv-cinder-806260-3-iscsi devstack@n-api.service[93397]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Sep 02 16:59:53.058894 dv-cinder-806260-3-iscsi devstack@n-api.service[93397]: Python main interpreter initialized at 0x562dd98ef9c0 Sep 02 16:59:53.058894 dv-cinder-806260-3-iscsi devstack@n-api.service[93397]: python threads support enabled Sep 02 16:59:53.058894 dv-cinder-806260-3-iscsi devstack@n-api.service[93397]: your server socket listen backlog is limited to 100 connections Sep 02 16:59:53.058894 dv-cinder-806260-3-iscsi devstack@n-api.service[93397]: your mercy for graceful operations on workers is 90 seconds Sep 02 16:59:53.059458 dv-cinder-806260-3-iscsi devstack@n-api.service[93397]: mapped 403077 bytes (393 KB) for 2 cores Sep 02 16:59:53.059458 dv-cinder-806260-3-iscsi devstack@n-api.service[93397]: *** Operational MODE: preforking *** Sep 02 16:59:53.059657 dv-cinder-806260-3-iscsi devstack@n-api.service[93397]: *** uWSGI is running in multiple interpreter mode *** Sep 02 16:59:53.059657 dv-cinder-806260-3-iscsi devstack@n-api.service[93397]: spawned uWSGI master process (pid: 93397) Sep 02 16:59:53.059917 dv-cinder-806260-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 02 16:59:53.060464 dv-cinder-806260-3-iscsi devstack@n-api.service[93397]: spawned uWSGI worker 1 (pid: 93398, cores: 1) Sep 02 16:59:53.062677 dv-cinder-806260-3-iscsi devstack@n-api.service[93397]: spawned uWSGI worker 2 (pid: 93399, cores: 1) Sep 02 16:59:53.062677 dv-cinder-806260-3-iscsi devstack@n-api.service[93397]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 02 16:59:55.027955 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 16:59:55.027955 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: from cryptography.utils import int_from_bytes Sep 02 16:59:55.029015 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 16:59:55.029015 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: from cryptography.utils import int_from_bytes Sep 02 16:59:55.474742 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 16:59:55.474742 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: from cryptography.utils import int_from_bytes Sep 02 16:59:55.475715 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 16:59:55.475715 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: from cryptography.utils import int_from_bytes Sep 02 16:59:58.400265 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 02 16:59:58.401169 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 02 16:59:58.401169 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 02 16:59:58.401438 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 02 16:59:58.401700 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 02 16:59:58.402192 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.402767 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.403122 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.403710 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.404236 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.404692 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.405244 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.405719 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.406059 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.406351 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.406757 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.407116 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-806260-3-iscsi {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.407497 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.407813 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.408128 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.408500 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.408807 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.409180 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.409548 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.410155 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.411617 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.411617 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.411617 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.411617 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.412176 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.412302 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.412589 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.412899 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.413226 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.413559 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.413966 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-806260-3-iscsi {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.414296 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.414595 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.414961 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.415388 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.415701 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.416046 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.416366 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.416695 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.417110 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.417666 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.418091 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.418418 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.418800 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.419152 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.419522 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.420370 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.420370 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.420716 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.420873 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.421056 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.421443 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.421768 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.422113 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.422460 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.422737 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.423030 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.423354 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.423777 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.424093 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.424403 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.424739 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.425078 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.425449 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.425741 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.426048 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.426588 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.427000 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.427510 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.427989 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.428355 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.428682 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.429095 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.429349 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.429680 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.430028 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.430369 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.430701 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.431088 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.431446 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.431799 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.432153 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.432450 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.432792 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.433117 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.433422 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.433672 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.433978 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.434318 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.434654 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.435003 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.435315 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.435641 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.435970 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.436278 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.436655 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.437111 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.437273 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.437562 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.437886 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.438188 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.438493 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.438893 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.439229 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.439552 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.439867 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.440169 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.440472 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.441309 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.441627 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.441933 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.442269 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.442593 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.442921 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.443234 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.443549 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.443855 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.444158 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.444572 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.444772 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.445075 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.445439 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.445742 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.446048 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.446347 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.446672 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.446976 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.447275 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.447576 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.447874 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.448173 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.448516 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.448880 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.449143 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.449478 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.449779 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.450092 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.450464 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.450817 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.451200 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.451537 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.451848 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.452201 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.452524 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.452833 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.453153 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.453482 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.453830 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.454138 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.454452 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.454792 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.455145 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.455477 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.455797 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.456152 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.456536 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.456848 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.457168 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.457498 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.457823 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.458136 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.458477 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.458846 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.459160 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.459492 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.459802 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.460156 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.460440 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.460751 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.461063 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.461380 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.461696 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.462005 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.462346 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.462684 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.463007 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.463158 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 02 16:59:58.463773 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.463898 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 02 16:59:58.464023 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.464023 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.464274 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.464404 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 02 16:59:58.464548 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.464800 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.464993 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 02 16:59:58.465132 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.465427 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.466067 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 02 16:59:58.466507 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.466665 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.466850 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.467173 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.467331 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.467522 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.467719 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.467867 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.468342 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.468490 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.468617 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.468749 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.468875 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.469086 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.469284 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.469417 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.469697 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.469829 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.470020 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.470330 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.470464 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.470761 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.471066 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.471234 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.471451 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.471599 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.471787 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.472063 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.472207 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.472462 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.472645 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-806260-3-iscsi {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.472799 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.473098 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.473231 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.473454 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.473746 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.473889 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.474082 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.474294 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.474449 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.474814 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.474962 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.475140 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.475423 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.475556 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.475819 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.475962 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.476186 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.476499 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.476640 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.476953 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.477131 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.477341 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.477520 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.477752 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.477898 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.478054 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.478361 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.478513 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.478710 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.478996 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.479140 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.479360 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.479592 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.479766 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.480085 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.480228 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.480391 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.480687 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.480833 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.481075 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.481247 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.481406 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.481748 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.481878 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.482066 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.482359 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.482837 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.483023 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.483169 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.483404 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.483719 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.483862 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-806260-3-iscsi {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.484034 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.484400 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.484550 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.484714 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.484984 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.485119 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.485337 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.485542 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.485714 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.485979 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.486293 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.486442 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.486722 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.486862 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.487030 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.487268 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.487394 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.487616 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.488028 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.488164 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.488310 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.488564 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.488700 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.488980 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.489122 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.489291 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.489616 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.489973 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.490100 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.490220 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.490354 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.490537 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.490764 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.490945 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.491309 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.491450 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.491647 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.491863 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.492046 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.492350 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.492484 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.492704 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.492957 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.493102 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.493342 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.493514 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.493648 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.493947 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.494088 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.494300 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.494589 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.494762 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.494960 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.495103 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.495297 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.495594 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.495728 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.495942 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.496171 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.496316 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.496548 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.496740 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.496882 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.497165 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.497293 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.497473 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.497748 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.497888 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.498083 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.498211 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.498415 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.498781 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.498942 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.499075 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.499332 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.499492 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.499680 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.499883 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.500024 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.500321 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.500459 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.500643 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.500953 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.501117 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.501312 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.501573 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.501704 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.501925 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.502065 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.502208 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.502537 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.502688 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.502916 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.503652 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.503799 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.504103 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.504231 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.504410 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.504756 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.504889 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.505131 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.505334 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.505465 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.505741 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.505892 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.506107 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.506445 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.506600 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.506761 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.506996 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.507142 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.507358 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.507738 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.507881 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.508108 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.508308 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.508444 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.508722 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.508946 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.509077 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.509320 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.509469 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.509632 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.509890 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.510039 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.510370 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.510516 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.510779 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.511060 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.511223 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.511513 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.511641 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.511828 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.512190 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.512323 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.512751 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.512898 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.513216 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.513344 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.513564 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.513884 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.514029 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.514230 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.514462 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.514602 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.514921 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.515083 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.515266 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.515479 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.515626 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.515900 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.516047 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.516209 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.516518 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.516646 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.516822 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.517114 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.517244 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.517448 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.517664 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.517815 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.518067 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.518221 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.518468 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.518853 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.519492 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.519714 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.520074 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.520207 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.520375 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.520510 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.520696 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.520950 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.521075 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.521302 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.521513 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.521677 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.522049 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.522182 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.522361 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.522654 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.522789 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.523032 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.523199 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.523391 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.523779 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.523946 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.524095 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.524291 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.524439 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.524750 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.524880 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.525094 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.525404 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.525554 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.525805 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.525992 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.526172 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.526481 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.526610 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.526848 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.527123 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.527260 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.527513 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.527649 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.527865 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.528169 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.528301 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.528480 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.528761 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.528900 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.529160 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.529303 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.529472 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.529775 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.529911 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.530123 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.530430 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.530577 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.530750 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.531026 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.531183 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.531462 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.531590 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.531790 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.532105 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.532240 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.532409 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.532672 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.532824 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.533043 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.533220 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.533414 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.533777 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.533915 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.534083 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.534348 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.534734 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.534867 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.535003 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.535233 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.535426 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.535618 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.535932 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.536095 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.536270 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.536515 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.536662 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.536873 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.537060 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.537221 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.537530 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.537669 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.537948 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.538132 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.538279 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.538980 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.539112 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.539537 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.539695 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.540078 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.540217 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.540523 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.540655 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.540904 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.541191 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.541324 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.541587 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.541834 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.541964 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.542197 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.542319 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.542564 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.542874 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.542992 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.543246 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.543397 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.543538 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.543868 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.544001 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 16:59:58.544237 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.544545 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.544697 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.544904 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.545117 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.545308 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.545732 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.545870 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.546064 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.546295 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.546439 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.546840 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.546986 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.547242 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.547501 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.547632 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.547816 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.548081 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.548218 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.548434 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.548655 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.548851 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.549049 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.549201 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.549390 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.549710 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.550054 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.550205 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.550362 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.550683 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.550799 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.551008 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.551225 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.551559 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.551710 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.551830 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.551956 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.552222 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.552349 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.552534 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.552738 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.552871 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.553141 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.553254 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.553447 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.553758 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.553845 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.554070 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.554264 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.554382 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.554729 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.554849 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.555037 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.555305 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.555524 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.555647 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.555826 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.555946 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.556233 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.556373 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.556541 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.556847 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.556978 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.557170 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.557420 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.557557 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.557770 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.557959 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.558092 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.558370 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.558541 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.558705 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.558994 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.559120 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.559439 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.559571 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.559749 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.560041 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.560189 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.560361 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.560559 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.560654 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.560965 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.561066 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.561279 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.561581 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.561708 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.561887 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.562081 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.562307 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.562614 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.562799 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.562955 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.563152 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.563299 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.563558 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.563699 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.563862 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.564170 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.564316 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.564479 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.564691 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.564844 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.565076 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.565216 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.565356 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.566220 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.566381 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.566524 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.566736 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.566878 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.567258 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.567429 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.567573 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.567778 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.567923 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.568263 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.568426 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.568576 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.568789 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.568887 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.569173 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.569323 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.569480 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.569803 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.569960 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.570104 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.570349 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.570500 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.570709 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.570899 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.571047 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.571343 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.571486 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.571637 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.571902 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.572064 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.572248 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.572399 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.572748 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.572917 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.573309 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.573463 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.573899 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.574072 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.574432 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.574603 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.574991 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.575147 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.575490 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.575639 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.575850 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.576030 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.576458 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.576614 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.577001 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.577154 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.577527 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.577696 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.578022 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.578169 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.578476 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.578617 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.579063 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.579216 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.579582 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.579722 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.580108 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.580249 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.580637 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.580776 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.581307 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.581461 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.581750 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.581887 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.582257 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.582399 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.582811 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.583037 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.583327 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.583466 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.583860 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.584002 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.584260 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.584399 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.584601 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.584845 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.584998 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.585287 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.585423 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.585619 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.585825 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.585977 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.586333 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.586468 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.586847 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.587006 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.587349 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.587601 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.587887 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.588104 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.588445 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.588697 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.589097 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.589407 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.589664 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.589851 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.590189 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.590331 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.590518 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.590904 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.591037 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.591483 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.591622 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.592056 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.592196 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.592689 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.592835 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.593040 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.593324 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.593484 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.593779 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.593914 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.594253 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.594492 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.594693 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.595129 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.595285 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.595581 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.595713 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.596050 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.596224 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.596567 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.596775 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.597654 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.597840 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.598234 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.598370 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.598846 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.599004 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.599438 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.599580 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.599814 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.600068 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.600230 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.600470 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.600636 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.600792 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.601129 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.601266 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.601445 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.601769 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.601891 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.602180 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.602354 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.602806 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.603013 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.603400 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.603584 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.603963 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.604193 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.604530 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.604769 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.605108 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.605448 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.605637 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.606035 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.606232 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.606764 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.606923 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.607258 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.607415 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.608142 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.608333 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.608610 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.608767 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.608963 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.609286 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.609387 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.609628 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.609850 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.609996 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.610274 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.610488 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.610677 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.610952 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.611104 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.611455 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.611599 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.611733 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.611892 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.612048 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.612190 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.613067 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.613219 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.613420 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.613711 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.613875 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.614291 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.614436 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.614668 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.614953 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.615114 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.615323 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.615518 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.615668 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.615868 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.616102 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.616263 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.616488 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.616673 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.616832 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.617205 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.617354 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.617562 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.617795 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.617893 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.618246 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.618383 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.618617 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.618945 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.619035 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.619313 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.619533 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.619633 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.619983 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.620109 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.620307 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.620683 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.620771 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.621003 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.621266 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.621359 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.621644 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.621849 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.621970 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.622288 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.622431 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.622603 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.622987 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.623098 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.623307 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.623596 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.623697 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.623989 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.624084 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.624303 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.624628 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.624796 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.624942 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.625242 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.625410 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.625635 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.625800 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.626171 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.626322 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.626514 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.626737 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.626883 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.627044 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.627482 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.627650 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.627794 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.628068 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.628223 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.628534 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.628701 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.628846 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.629200 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.629351 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.629520 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.629796 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.629966 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.630139 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.630354 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.630501 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.630773 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.630944 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.631132 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.631441 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.631594 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.631759 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.632079 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.632229 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.632375 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.632681 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.632830 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.633070 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.633259 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.633643 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.633851 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.634025 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.634313 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.634461 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.634699 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.635003 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.635157 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.635368 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.635585 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.635738 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.636126 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.636286 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.636442 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.636742 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.636960 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.637125 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.637419 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.637568 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.637721 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.638026 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.638194 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.638351 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.638685 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.638897 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.639087 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.639289 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.639475 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.639680 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.640140 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.640345 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.640345 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.640624 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.640776 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.640929 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.641070 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.641296 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.641459 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.641666 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.641807 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.641954 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.642207 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.642355 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.642521 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.643037 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.643208 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.643208 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.643455 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.643588 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.643823 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.644137 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.644302 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.644455 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.644765 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.644903 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.645079 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.645388 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.645542 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.645741 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.645961 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.646103 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.646361 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.646539 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.646839 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.647049 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.647140 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.647375 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.647717 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.647883 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.648022 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.648308 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.648507 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.648737 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.648871 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.649335 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.649490 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.649653 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.649974 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.650151 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.650415 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.650517 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.650724 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.651052 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.651142 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.651426 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.651692 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.651782 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.652054 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.652248 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.652388 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.652676 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.652805 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.652983 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.653334 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.653443 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.653649 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.653867 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.654026 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.654263 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.654440 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.654596 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.654942 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.655037 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.655330 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.655487 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.655652 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.655971 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.656058 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.656288 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.656485 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.656847 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.656994 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.657165 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.657477 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.657564 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.657792 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.657983 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.658104 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.658453 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.658606 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.658813 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.658979 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.659123 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.659275 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.659978 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.660146 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.660427 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.660655 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.660782 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.660900 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.661079 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.661198 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.661444 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.661607 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.661763 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.662062 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.662215 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.662387 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.662739 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.662889 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.663084 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.663255 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.663399 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.663711 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.663859 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.664139 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.664287 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.664533 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.664726 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.664878 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.665074 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.665219 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.665362 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.665642 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.665796 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.665968 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.666110 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.666301 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.666465 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.666878 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.667028 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.667174 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.667394 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.667539 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.667699 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.667839 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.667975 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.668122 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.668267 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.668417 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.668570 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.668709 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.668848 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.668988 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.669126 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.669265 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.669427 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.669568 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.669706 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.669852 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.669993 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.670146 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.670297 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.670470 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.670696 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.670923 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.671064 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.671217 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.671359 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.671623 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.671772 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.672014 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.672263 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.672425 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.672667 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.672800 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.672987 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.673223 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.673548 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.673713 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.673849 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.673994 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.674176 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.674321 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.674515 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.674721 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.674914 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.675897 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.676053 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.676156 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.676252 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.676391 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.676644 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.676784 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.676973 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.677276 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.677440 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.677612 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.677753 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.677937 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.678081 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.678288 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.678456 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.678597 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.678805 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.678994 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.679139 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.679358 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.679499 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.679639 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93399) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 02 16:59:58.679778 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.680029 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.680342 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.680656 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.680966 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.681275 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.681589 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.681897 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.682203 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.682513 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.682847 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.683153 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.683457 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.683781 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.684094 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.684399 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.684705 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.685030 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.685358 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.685667 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.686028 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.686337 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.686699 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.687001 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.687312 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.687624 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.687943 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.688248 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.688569 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.688875 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.689192 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.689489 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.689799 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.690116 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.690424 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.690800 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.691121 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.691441 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.691769 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.692074 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.692381 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.692689 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.692993 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.693301 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.693608 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.693919 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.694230 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.694538 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.694871 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.695182 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.695484 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.695791 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.696097 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.696402 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.696729 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.697033 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.697336 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.697648 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.698288 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.699076 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.699395 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.699839 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.700153 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.700463 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.700770 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.701084 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.701402 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.701717 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.702033 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.702337 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.702802 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.703290 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.703739 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.703897 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG oslo_db.sqlalchemy.engines [None req-4041cf81-2dfb-4246-a39d-4db730fe979d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93399) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 16:59:58.704241 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.704669 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.705270 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.705579 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.706026 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.706972 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.707375 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.707780 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.708263 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.708702 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.709224 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.709794 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.710203 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.710685 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.711191 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.711657 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.712065 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.712484 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.712896 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.713346 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.713736 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.714100 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.714458 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.714970 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.715493 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.715978 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.716390 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.716768 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.717184 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.717662 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.718073 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.718554 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.719156 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.719600 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.719986 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.720386 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.720778 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.721167 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.721547 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.722101 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.722369 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.722883 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.723638 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.723638 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.724087 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.724477 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.724857 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.725388 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.725829 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.726003 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.726388 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.726809 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.727204 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.727593 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.727993 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.728366 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.728756 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.729136 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.729596 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.729989 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.730364 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.730821 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.731387 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.731785 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.732185 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.732853 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.733277 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.733688 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.734183 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.734570 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.734993 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.735385 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.735762 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.736177 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.736556 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.736931 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.737322 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.738430 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.738875 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.739190 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.739644 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.740030 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.740428 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.740807 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.741196 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.741579 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.741954 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.742385 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.742750 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.743248 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.743641 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.744090 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.744539 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.744944 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.745379 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.745797 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.746258 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.746669 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.747072 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.747522 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.747998 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.748471 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.749043 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.749592 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.750127 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.750696 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.751257 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.751813 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.752793 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.753366 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.753881 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.754412 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.755010 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.755570 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.756148 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.756716 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.757279 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.757848 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.758412 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.759059 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.759655 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.760241 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.760847 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.761432 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.762003 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.762561 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.763160 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.763799 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.764374 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.764932 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.765501 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.766048 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.766600 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.767212 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.767789 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.768376 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.769487 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.770070 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.770663 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.771243 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.771820 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.772432 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.773044 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.773633 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.774206 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.774813 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.775387 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.776387 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.776951 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.777544 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.778128 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.778729 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.779268 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.779751 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.780269 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.780761 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.781254 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.781766 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.782265 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.782822 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.783273 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.783828 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.784431 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.785009 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.785555 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.786580 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.787309 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.787864 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.788474 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.789018 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.789578 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.790118 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.790739 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.791263 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.791798 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.792372 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.792919 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.793464 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.793996 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.794556 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.795147 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.795679 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.796224 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.796763 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.797347 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.797889 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.798433 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.799005 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.799564 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.800633 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.801184 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.801731 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.802275 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.802894 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.803426 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.803974 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.804510 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.805067 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.805608 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.806136 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.806718 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.807298 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.807856 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.808390 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.808957 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.809501 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.810084 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.810695 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.811188 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.811824 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.812170 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.812783 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.813228 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.813589 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.813949 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.814381 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.814976 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.815525 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.816621 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.817207 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.817775 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.818315 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.818921 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.819500 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.820079 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.820654 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.821439 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.821835 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.822362 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.822988 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.823534 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.824082 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.824636 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.825222 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.825804 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.826391 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.827003 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.827581 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.828172 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.828792 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.829383 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.829958 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.830799 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.831414 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.832008 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.832607 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.833460 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.834065 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.834697 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.835284 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.835864 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.836445 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.837063 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.837694 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.838302 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.838925 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.839495 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.840066 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.840636 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.841216 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.841839 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.842431 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.842960 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.843414 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.843752 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.844080 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.844414 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.844748 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.845082 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.845401 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.845744 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.846060 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.846378 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.846722 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.847078 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.847393 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.847705 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.848045 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.848369 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.848682 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.849011 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.849323 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.849901 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.850229 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.850541 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.850912 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.851226 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.851539 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.851865 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.852163 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.852485 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.852803 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.853140 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.853461 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.853785 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.854108 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.854466 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.854803 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.855314 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.855472 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 16:59:58.855712 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93398) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 02 16:59:58.882006 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG oslo_db.sqlalchemy.engines [None req-f8e462f4-041c-4a5f-ad1f-147cc1365340 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93398) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 16:59:58.894382 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.context [None req-4041cf81-2dfb-4246-a39d-4db730fe979d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3e42ac8c-9d05-40cd-947b-9719402da6b0(cell1) {{(pid=93399) load_cells /opt/stack/nova/nova/context.py:464}} Sep 02 16:59:58.898938 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG oslo_concurrency.lockutils [None req-4041cf81-2dfb-4246-a39d-4db730fe979d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 16:59:58.900563 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG oslo_concurrency.lockutils [None req-4041cf81-2dfb-4246-a39d-4db730fe979d None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 16:59:58.901399 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG oslo_concurrency.lockutils [None req-4041cf81-2dfb-4246-a39d-4db730fe979d None None] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 16:59:58.903418 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG oslo_concurrency.lockutils [None req-4041cf81-2dfb-4246-a39d-4db730fe979d None None] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93399) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 16:59:58.916038 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG oslo_db.sqlalchemy.engines [None req-4041cf81-2dfb-4246-a39d-4db730fe979d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93399) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 16:59:58.919197 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG oslo_db.sqlalchemy.engines [None req-4041cf81-2dfb-4246-a39d-4db730fe979d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93399) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 16:59:59.071315 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.context [None req-f8e462f4-041c-4a5f-ad1f-147cc1365340 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3e42ac8c-9d05-40cd-947b-9719402da6b0(cell1) {{(pid=93398) load_cells /opt/stack/nova/nova/context.py:464}} Sep 02 16:59:59.075824 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG oslo_concurrency.lockutils [None req-f8e462f4-041c-4a5f-ad1f-147cc1365340 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 16:59:59.077419 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG oslo_concurrency.lockutils [None req-f8e462f4-041c-4a5f-ad1f-147cc1365340 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 16:59:59.078248 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG oslo_concurrency.lockutils [None req-f8e462f4-041c-4a5f-ad1f-147cc1365340 None None] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 16:59:59.080252 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG oslo_concurrency.lockutils [None req-f8e462f4-041c-4a5f-ad1f-147cc1365340 None None] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 16:59:59.093381 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG oslo_db.sqlalchemy.engines [None req-f8e462f4-041c-4a5f-ad1f-147cc1365340 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93398) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 16:59:59.096241 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG oslo_db.sqlalchemy.engines [None req-f8e462f4-041c-4a5f-ad1f-147cc1365340 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93398) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 16:59:59.255216 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG oslo_db.sqlalchemy.engines [None req-4041cf81-2dfb-4246-a39d-4db730fe979d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93399) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 16:59:59.390081 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG oslo_db.sqlalchemy.engines [None req-f8e462f4-041c-4a5f-ad1f-147cc1365340 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93398) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 16:59:59.700221 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: WARNING keystonemiddleware.auth_token [None req-4041cf81-2dfb-4246-a39d-4db730fe979d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 16:59:59.710966 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: WARNING keystonemiddleware.auth_token [None req-4041cf81-2dfb-4246-a39d-4db730fe979d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 16:59:59.771753 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: WARNING keystonemiddleware.auth_token [None req-f8e462f4-041c-4a5f-ad1f-147cc1365340 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 16:59:59.778470 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: WARNING keystonemiddleware.auth_token [None req-f8e462f4-041c-4a5f-ad1f-147cc1365340 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 17:00:00.142435 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: WARNING keystonemiddleware.auth_token [None req-4041cf81-2dfb-4246-a39d-4db730fe979d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 17:00:00.149019 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: WARNING keystonemiddleware.auth_token [None req-4041cf81-2dfb-4246-a39d-4db730fe979d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 17:00:00.156071 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x562dd98ef9c0 pid: 93399 (default app) Sep 02 17:00:00.158404 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-4041cf81-2dfb-4246-a39d-4db730fe979d None None] Calling method '>' {{(pid=93399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:00:00.160256 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.requestlog [None req-4041cf81-2dfb-4246-a39d-4db730fe979d None None] 10.222.0.41 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002506 Sep 02 17:00:00.160680 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: [pid: 93399|app: 0|req: 1/1] 10.222.0.41 () {50 vars in 789 bytes} [Thu Sep 2 17:00:00 2021] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:00:00.184728 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: WARNING keystonemiddleware.auth_token [None req-f8e462f4-041c-4a5f-ad1f-147cc1365340 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 17:00:00.190338 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: WARNING keystonemiddleware.auth_token [None req-f8e462f4-041c-4a5f-ad1f-147cc1365340 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 17:00:00.196693 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x562dd98ef9c0 pid: 93398 (default app) Sep 02 17:01:33.743086 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-4041cf81-2dfb-4246-a39d-4db730fe979d None None] Calling method '>' {{(pid=93399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:01:33.744642 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.requestlog [None req-4041cf81-2dfb-4246-a39d-4db730fe979d None None] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002610 Sep 02 17:01:33.745149 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: [pid: 93399|app: 0|req: 2/2] 10.222.0.41 () {54 vars in 931 bytes} [Thu Sep 2 17:01:33 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:01:34.334387 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-a6114f87-92e8-4656-a805-394065f0d5f2 admin admin] Calling method '>' {{(pid=93398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:01:34.375076 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.requestlog [None req-a6114f87-92e8-4656-a805-394065f0d5f2 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.620840 Sep 02 17:01:34.376198 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: [pid: 93398|app: 0|req: 1/3] 10.222.0.41 () {60 vars in 1292 bytes} [Thu Sep 2 17:01:33 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:01:36.916076 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-4041cf81-2dfb-4246-a39d-4db730fe979d None None] Calling method '>' {{(pid=93399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:01:36.919906 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.requestlog [None req-4041cf81-2dfb-4246-a39d-4db730fe979d None None] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003789 Sep 02 17:01:36.921036 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: [pid: 93399|app: 0|req: 3/4] 10.222.0.41 () {54 vars in 931 bytes} [Thu Sep 2 17:01:36 2021] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:01:36.992165 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-5c84cf67-c27a-4347-8928-0f9ed7d74203 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "disk": 1, "ram": 256, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "name": "cirros256", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=93398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:01:37.012662 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:01:37.012662 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: warnings.warn(msg) Sep 02 17:01:37.048361 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.requestlog [None req-5c84cf67-c27a-4347-8928-0f9ed7d74203 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.115450 Sep 02 17:01:37.050546 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: [pid: 93398|app: 0|req: 2/5] 10.222.0.41 () {64 vars in 1283 bytes} [Thu Sep 2 17:01:36 2021] POST /compute/v2.1/flavors => generated 407 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:01:37.459095 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-8a0012a4-e27c-49c7-a18c-02f105e66ce7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:01:37.463390 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:01:37.463390 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: warnings.warn(msg) Sep 02 17:01:37.551658 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.requestlog [None req-8a0012a4-e27c-49c7-a18c-02f105e66ce7 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.489568 Sep 02 17:01:37.558754 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: [pid: 93399|app: 0|req: 4/6] 10.222.0.41 () {64 vars in 1336 bytes} [Thu Sep 2 17:01:37 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:01:40.011506 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-5c84cf67-c27a-4347-8928-0f9ed7d74203 admin admin] Calling method '>' {{(pid=93398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:01:40.012800 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.requestlog [None req-5c84cf67-c27a-4347-8928-0f9ed7d74203 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001930 Sep 02 17:01:40.013283 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: [pid: 93398|app: 0|req: 3/7] 10.222.0.41 () {54 vars in 931 bytes} [Thu Sep 2 17:01:40 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:01:40.131566 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-38df3b63-eeb3-4d99-b641-c134cbd7e4ee admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 5, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d1", "swap": 0, "name": "ds512M"}} {{(pid=93399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:01:40.154477 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:01:40.154477 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: warnings.warn(msg) Sep 02 17:01:40.185886 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.requestlog [None req-38df3b63-eeb3-4d99-b641-c134cbd7e4ee admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.165084 Sep 02 17:01:40.186740 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: [pid: 93399|app: 0|req: 5/8] 10.222.0.41 () {64 vars in 1283 bytes} [Thu Sep 2 17:01:40 2021] POST /compute/v2.1/flavors => generated 404 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:01:40.204640 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-785aa2b0-2cf3-4007-b6bd-87ae7087b7e8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:01:40.207111 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:01:40.207111 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: warnings.warn(msg) Sep 02 17:01:40.252883 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.requestlog [None req-785aa2b0-2cf3-4007-b6bd-87ae7087b7e8 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052167 Sep 02 17:01:40.253843 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: [pid: 93398|app: 0|req: 4/9] 10.222.0.41 () {64 vars in 1336 bytes} [Thu Sep 2 17:01:40 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:01:42.619990 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-38df3b63-eeb3-4d99-b641-c134cbd7e4ee admin admin] Calling method '>' {{(pid=93399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:01:42.621750 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.requestlog [None req-38df3b63-eeb3-4d99-b641-c134cbd7e4ee admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002488 Sep 02 17:01:42.622463 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: [pid: 93399|app: 0|req: 6/10] 10.222.0.41 () {54 vars in 931 bytes} [Thu Sep 2 17:01:42 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:01:42.703274 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-d24fa075-ebe1-4259-a9ed-0717ca5d0290 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "id": "d2", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024}} {{(pid=93398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:01:42.726984 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.requestlog [None req-d24fa075-ebe1-4259-a9ed-0717ca5d0290 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.093181 Sep 02 17:01:42.734795 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: [pid: 93398|app: 0|req: 5/11] 10.222.0.41 () {64 vars in 1283 bytes} [Thu Sep 2 17:01:42 2021] POST /compute/v2.1/flavors => generated 404 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:01:42.741449 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-92f17772-e13d-44c7-8641-cc0c63751fa4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:01:42.769560 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.requestlog [None req-92f17772-e13d-44c7-8641-cc0c63751fa4 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031811 Sep 02 17:01:42.770438 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: [pid: 93399|app: 0|req: 7/12] 10.222.0.41 () {64 vars in 1336 bytes} [Thu Sep 2 17:01:42 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:01:45.207170 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-d24fa075-ebe1-4259-a9ed-0717ca5d0290 admin admin] Calling method '>' {{(pid=93398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:01:45.208188 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.requestlog [None req-d24fa075-ebe1-4259-a9ed-0717ca5d0290 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001710 Sep 02 17:01:45.208589 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: [pid: 93398|app: 0|req: 6/13] 10.222.0.41 () {54 vars in 931 bytes} [Thu Sep 2 17:01:45 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:01:45.293207 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-e33e98e4-cabf-411e-a6f9-b90449cb7102 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "vcpus": 2, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "ram": 2048, "rxtx_factor": 1.0, "name": "ds2G"}} {{(pid=93399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:01:45.319013 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.requestlog [None req-e33e98e4-cabf-411e-a6f9-b90449cb7102 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.099715 Sep 02 17:01:45.319013 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: [pid: 93399|app: 0|req: 8/14] 10.222.0.41 () {64 vars in 1283 bytes} [Thu Sep 2 17:01:45 2021] POST /compute/v2.1/flavors => generated 404 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:01:45.336540 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-2f8f6f0a-ffae-4e1c-81ca-96e48254996d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:01:45.370542 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.requestlog [None req-2f8f6f0a-ffae-4e1c-81ca-96e48254996d admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038693 Sep 02 17:01:45.371473 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: [pid: 93398|app: 0|req: 7/15] 10.222.0.41 () {64 vars in 1336 bytes} [Thu Sep 2 17:01:45 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:01:48.007227 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-e33e98e4-cabf-411e-a6f9-b90449cb7102 admin admin] Calling method '>' {{(pid=93399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:01:48.008139 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.requestlog [None req-e33e98e4-cabf-411e-a6f9-b90449cb7102 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Sep 02 17:01:48.008550 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: [pid: 93399|app: 0|req: 9/16] 10.222.0.41 () {54 vars in 931 bytes} [Thu Sep 2 17:01:48 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:01:48.087325 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-23070e98-9de5-4bc2-92f8-f58d229af984 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "os-flavor-access:is_public": true, "vcpus": 4, "swap": 0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "rxtx_factor": 1.0, "name": "ds4G"}} {{(pid=93398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:01:48.114149 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.requestlog [None req-23070e98-9de5-4bc2-92f8-f58d229af984 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.098325 Sep 02 17:01:48.115253 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: [pid: 93398|app: 0|req: 8/17] 10.222.0.41 () {64 vars in 1283 bytes} [Thu Sep 2 17:01:48 2021] POST /compute/v2.1/flavors => generated 404 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:01:48.133602 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-94a6250d-bf9a-4bab-ab54-15d9d926fae1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:01:48.165197 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.requestlog [None req-94a6250d-bf9a-4bab-ab54-15d9d926fae1 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035225 Sep 02 17:01:48.166759 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: [pid: 93399|app: 0|req: 10/18] 10.222.0.41 () {64 vars in 1336 bytes} [Thu Sep 2 17:01:48 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:01:50.609603 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-23070e98-9de5-4bc2-92f8-f58d229af984 admin admin] Calling method '>' {{(pid=93398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:01:50.612199 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.requestlog [None req-23070e98-9de5-4bc2-92f8-f58d229af984 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003024 Sep 02 17:01:50.620044 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: [pid: 93398|app: 0|req: 9/19] 10.222.0.41 () {54 vars in 931 bytes} [Thu Sep 2 17:01:50 2021] GET /compute/v2.1 => generated 388 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:01:50.682022 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-30a27ae6-ee0c-4e66-8b38-c114f66d768e admin admin] Calling method '>' {{(pid=93399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:01:50.716295 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.requestlog [None req-30a27ae6-ee0c-4e66-8b38-c114f66d768e admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.095026 Sep 02 17:01:50.718039 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: [pid: 93399|app: 0|req: 11/20] 10.222.0.41 () {60 vars in 1292 bytes} [Thu Sep 2 17:01:50 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:01:53.488934 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-23070e98-9de5-4bc2-92f8-f58d229af984 admin admin] Calling method '>' {{(pid=93398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:01:53.490180 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.requestlog [None req-23070e98-9de5-4bc2-92f8-f58d229af984 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001901 Sep 02 17:01:53.490688 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: [pid: 93398|app: 0|req: 10/21] 10.222.0.41 () {54 vars in 931 bytes} [Thu Sep 2 17:01:53 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:01:53.568086 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-c78ee1d5-5584-4a04-85c2-060ce250dfa2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "name": "m1.tiny", "id": "1", "disk": 1, "rxtx_factor": 1.0, "ram": 512}} {{(pid=93399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:01:53.595281 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.requestlog [None req-c78ee1d5-5584-4a04-85c2-060ce250dfa2 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.095768 Sep 02 17:01:53.596033 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: [pid: 93399|app: 0|req: 12/22] 10.222.0.41 () {64 vars in 1283 bytes} [Thu Sep 2 17:01:53 2021] POST /compute/v2.1/flavors => generated 402 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:01:53.608461 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-9cee265f-9a3f-4ee4-bb12-4e960d440cb0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:01:53.638316 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.requestlog [None req-9cee265f-9a3f-4ee4-bb12-4e960d440cb0 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033396 Sep 02 17:01:53.639331 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: [pid: 93398|app: 0|req: 11/23] 10.222.0.41 () {64 vars in 1333 bytes} [Thu Sep 2 17:01:53 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:01:56.671142 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-c78ee1d5-5584-4a04-85c2-060ce250dfa2 admin admin] Calling method '>' {{(pid=93399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:01:56.672895 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.requestlog [None req-c78ee1d5-5584-4a04-85c2-060ce250dfa2 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002611 Sep 02 17:01:56.673591 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: [pid: 93399|app: 0|req: 13/24] 10.222.0.41 () {54 vars in 931 bytes} [Thu Sep 2 17:01:56 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:01:56.762832 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-f97e348a-2db2-48a8-beb7-46bc4f7856b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "disk": 20, "name": "m1.small", "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=93398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:01:56.784455 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.requestlog [None req-f97e348a-2db2-48a8-beb7-46bc4f7856b9 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.100524 Sep 02 17:01:56.785015 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: [pid: 93398|app: 0|req: 12/25] 10.222.0.41 () {64 vars in 1283 bytes} [Thu Sep 2 17:01:56 2021] POST /compute/v2.1/flavors => generated 405 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:01:56.804435 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-f29690e8-249b-464f-a058-56436af25d74 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:01:56.839777 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.requestlog [None req-f29690e8-249b-464f-a058-56436af25d74 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040804 Sep 02 17:01:56.842847 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: [pid: 93399|app: 0|req: 14/26] 10.222.0.41 () {64 vars in 1333 bytes} [Thu Sep 2 17:01:56 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:01:59.223163 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-f97e348a-2db2-48a8-beb7-46bc4f7856b9 admin admin] Calling method '>' {{(pid=93398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:01:59.225912 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.requestlog [None req-f97e348a-2db2-48a8-beb7-46bc4f7856b9 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Sep 02 17:01:59.225912 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: [pid: 93398|app: 0|req: 13/27] 10.222.0.41 () {54 vars in 931 bytes} [Thu Sep 2 17:01:59 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:01:59.304098 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-4c26b9f7-a49d-49ad-b683-532fedd18bfd admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "disk": 40, "name": "m1.medium", "ram": 4096, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=93399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:01:59.329393 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.requestlog [None req-4c26b9f7-a49d-49ad-b683-532fedd18bfd admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.085673 Sep 02 17:01:59.330337 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: [pid: 93399|app: 0|req: 15/28] 10.222.0.41 () {64 vars in 1283 bytes} [Thu Sep 2 17:01:59 2021] POST /compute/v2.1/flavors => generated 406 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:01:59.343009 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-3cca044a-dbb7-43a8-977c-16908ce00a8b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:01:59.367413 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.requestlog [None req-3cca044a-dbb7-43a8-977c-16908ce00a8b admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028263 Sep 02 17:01:59.368006 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: [pid: 93398|app: 0|req: 14/29] 10.222.0.41 () {64 vars in 1333 bytes} [Thu Sep 2 17:01:59 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:02:01.847434 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-4c26b9f7-a49d-49ad-b683-532fedd18bfd admin admin] Calling method '>' {{(pid=93399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:02:01.849081 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.requestlog [None req-4c26b9f7-a49d-49ad-b683-532fedd18bfd admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002130 Sep 02 17:02:01.849475 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: [pid: 93399|app: 0|req: 16/30] 10.222.0.41 () {54 vars in 931 bytes} [Thu Sep 2 17:02:01 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:02:01.926655 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-d72b6d13-c9dc-4028-bd30-0b460d2fa75f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "os-flavor-access:is_public": true, "name": "m1.large", "rxtx_factor": 1.0, "ram": 8192, "swap": 0, "disk": 80, "vcpus": 4}} {{(pid=93398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:02:01.947290 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.requestlog [None req-d72b6d13-c9dc-4028-bd30-0b460d2fa75f admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.089396 Sep 02 17:02:01.948153 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: [pid: 93398|app: 0|req: 15/31] 10.222.0.41 () {64 vars in 1283 bytes} [Thu Sep 2 17:02:01 2021] POST /compute/v2.1/flavors => generated 405 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:02:01.969409 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-18d65014-115d-40cc-84ec-0de6768f1943 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:02:02.003617 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.requestlog [None req-18d65014-115d-40cc-84ec-0de6768f1943 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037474 Sep 02 17:02:02.005122 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: [pid: 93399|app: 0|req: 17/32] 10.222.0.41 () {64 vars in 1333 bytes} [Thu Sep 2 17:02:01 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:02:04.558480 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-d72b6d13-c9dc-4028-bd30-0b460d2fa75f admin admin] Calling method '>' {{(pid=93398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:02:04.560901 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.requestlog [None req-d72b6d13-c9dc-4028-bd30-0b460d2fa75f admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003130 Sep 02 17:02:04.561694 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: [pid: 93398|app: 0|req: 16/33] 10.222.0.41 () {54 vars in 931 bytes} [Thu Sep 2 17:02:04 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:02:04.655431 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-963be633-24e4-452d-8374-a5dfa781e853 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "vcpus": 8, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "id": "5", "os-flavor-access:is_public": true, "disk": 160}} {{(pid=93399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:02:04.680632 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.requestlog [None req-963be633-24e4-452d-8374-a5dfa781e853 admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.108871 Sep 02 17:02:04.681515 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: [pid: 93399|app: 0|req: 18/34] 10.222.0.41 () {64 vars in 1283 bytes} [Thu Sep 2 17:02:04 2021] POST /compute/v2.1/flavors => generated 408 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:02:04.694059 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-89e17e7b-8abe-4635-a589-0e1c4ff96dad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:02:04.736123 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.requestlog [None req-89e17e7b-8abe-4635-a589-0e1c4ff96dad admin admin] 10.222.0.41 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045119 Sep 02 17:02:04.737138 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: [pid: 93398|app: 0|req: 17/35] 10.222.0.41 () {64 vars in 1333 bytes} [Thu Sep 2 17:02:04 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:02:45.136640 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-963be633-24e4-452d-8374-a5dfa781e853 admin admin] Calling method '>' {{(pid=93399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:02:45.138319 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.requestlog [None req-963be633-24e4-452d-8374-a5dfa781e853 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002425 Sep 02 17:02:45.139090 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: [pid: 93399|app: 0|req: 19/36] 10.222.0.41 () {54 vars in 931 bytes} [Thu Sep 2 17:02:45 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:02:45.207816 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-584b48cd-634e-45ed-af74-18c5f1b15026 admin admin] Calling method '>' {{(pid=93398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:02:45.232079 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.requestlog [None req-584b48cd-634e-45ed-af74-18c5f1b15026 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.082270 Sep 02 17:02:45.232660 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: [pid: 93398|app: 0|req: 18/37] 10.222.0.41 () {60 vars in 1292 bytes} [Thu Sep 2 17:02:45 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:02:46.714316 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-963be633-24e4-452d-8374-a5dfa781e853 admin admin] Calling method '>' {{(pid=93399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:02:46.715885 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.requestlog [None req-963be633-24e4-452d-8374-a5dfa781e853 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001903 Sep 02 17:02:46.716383 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: [pid: 93399|app: 0|req: 20/38] 10.222.0.41 () {56 vars in 1075 bytes} [Thu Sep 2 17:02:46 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:02:46.940217 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-9fae904e-8964-476c-ba1b-48f7a8e252ce admin admin] Calling method '>' {{(pid=93398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:02:46.945959 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.wsgi [None req-9fae904e-8964-476c-ba1b-48f7a8e252ce admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 02 17:02:46.946531 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-9fae904e-8964-476c-ba1b-48f7a8e252ce admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=93398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:02:46.947373 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.requestlog [None req-9fae904e-8964-476c-ba1b-48f7a8e252ce admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.078964 Sep 02 17:02:46.947921 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: [pid: 93398|app: 0|req: 19/39] 10.222.0.41 () {60 vars in 1191 bytes} [Thu Sep 2 17:02:46 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 02 17:02:46.961350 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-79536e8a-c689-4da9-be1c-ec4020e1323b admin admin] Calling method '>' {{(pid=93399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:02:46.984528 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.requestlog [None req-79536e8a-c689-4da9-be1c-ec4020e1323b admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026719 Sep 02 17:02:46.985433 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: [pid: 93399|app: 0|req: 21/40] 10.222.0.41 () {60 vars in 1211 bytes} [Thu Sep 2 17:02:46 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:02:46.996552 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-19aa8dfa-c636-45c8-bd8a-13a4de00ec4a admin admin] Calling method '>' {{(pid=93398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:02:47.019768 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.requestlog [None req-19aa8dfa-c636-45c8-bd8a-13a4de00ec4a admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.026829 Sep 02 17:02:47.020333 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: [pid: 93398|app: 0|req: 20/41] 10.222.0.41 () {60 vars in 1211 bytes} [Thu Sep 2 17:02:46 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:02:47.035921 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-3d7907cc-f4b6-4a76-8d47-7d05fde1c9e1 admin admin] Calling method '>' {{(pid=93399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:02:47.041909 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.wsgi [None req-3d7907cc-f4b6-4a76-8d47-7d05fde1c9e1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 02 17:02:47.042488 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-3d7907cc-f4b6-4a76-8d47-7d05fde1c9e1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=93399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:02:47.043666 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.requestlog [None req-3d7907cc-f4b6-4a76-8d47-7d05fde1c9e1 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.012335 Sep 02 17:02:47.044228 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: [pid: 93399|app: 0|req: 22/42] 10.222.0.41 () {60 vars in 1191 bytes} [Thu Sep 2 17:02:47 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 02 17:02:48.459079 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-19aa8dfa-c636-45c8-bd8a-13a4de00ec4a admin admin] Calling method '>' {{(pid=93398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:02:48.460121 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.requestlog [None req-19aa8dfa-c636-45c8-bd8a-13a4de00ec4a admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Sep 02 17:02:48.460580 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: [pid: 93398|app: 0|req: 21/43] 10.222.0.41 () {56 vars in 1075 bytes} [Thu Sep 2 17:02:48 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:02:48.675976 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-40f6a511-7989-4762-b490-c0b2f539fe77 admin admin] Calling method '>' {{(pid=93399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:02:48.681743 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.wsgi [None req-40f6a511-7989-4762-b490-c0b2f539fe77 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 02 17:02:48.682360 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-40f6a511-7989-4762-b490-c0b2f539fe77 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=93399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:02:48.683252 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.requestlog [None req-40f6a511-7989-4762-b490-c0b2f539fe77 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.067888 Sep 02 17:02:48.683837 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: [pid: 93399|app: 0|req: 23/44] 10.222.0.41 () {60 vars in 1191 bytes} [Thu Sep 2 17:02:48 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 02 17:02:48.694019 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-6aa08b91-f62d-46ee-a9b3-c1470156c761 admin admin] Calling method '>' {{(pid=93398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:02:48.708561 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.requestlog [None req-6aa08b91-f62d-46ee-a9b3-c1470156c761 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.018115 Sep 02 17:02:48.709134 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: [pid: 93398|app: 0|req: 22/45] 10.222.0.41 () {60 vars in 1211 bytes} [Thu Sep 2 17:02:48 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:02:48.720567 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-4f16e9f4-6998-42da-b97a-77778b21982f admin admin] Calling method '>' {{(pid=93399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:02:48.737010 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.requestlog [None req-4f16e9f4-6998-42da-b97a-77778b21982f admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.020961 Sep 02 17:02:48.737753 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: [pid: 93399|app: 0|req: 24/46] 10.222.0.41 () {60 vars in 1211 bytes} [Thu Sep 2 17:02:48 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:02:48.749270 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-ef99e52e-4f0c-497e-8579-af98c68d2d4a admin admin] Calling method '>' {{(pid=93398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:02:48.755255 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.wsgi [None req-ef99e52e-4f0c-497e-8579-af98c68d2d4a admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 02 17:02:48.755879 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-ef99e52e-4f0c-497e-8579-af98c68d2d4a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=93398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:02:48.756717 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.requestlog [None req-ef99e52e-4f0c-497e-8579-af98c68d2d4a admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.011435 Sep 02 17:02:48.757304 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: [pid: 93398|app: 0|req: 23/47] 10.222.0.41 () {60 vars in 1191 bytes} [Thu Sep 2 17:02:48 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 02 17:02:50.221242 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-4f16e9f4-6998-42da-b97a-77778b21982f admin admin] Calling method '>' {{(pid=93399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:02:50.222807 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.requestlog [None req-4f16e9f4-6998-42da-b97a-77778b21982f admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001829 Sep 02 17:02:50.223381 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: [pid: 93399|app: 0|req: 25/48] 10.222.0.41 () {56 vars in 1075 bytes} [Thu Sep 2 17:02:50 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:02:50.425339 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-f5d043b7-8177-43e6-be0e-952330d66f0b admin admin] Calling method '>' {{(pid=93398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:02:50.431171 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.wsgi [None req-f5d043b7-8177-43e6-be0e-952330d66f0b admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 02 17:02:50.431733 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-f5d043b7-8177-43e6-be0e-952330d66f0b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=93398) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:02:50.432536 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.requestlog [None req-f5d043b7-8177-43e6-be0e-952330d66f0b admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.069007 Sep 02 17:02:50.433074 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: [pid: 93398|app: 0|req: 24/49] 10.222.0.41 () {60 vars in 1194 bytes} [Thu Sep 2 17:02:50 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 02 17:02:50.443540 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-dbf768a8-b527-4fdf-9c52-dba3478eb95e admin admin] Calling method '>' {{(pid=93399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:02:50.457927 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.requestlog [None req-dbf768a8-b527-4fdf-9c52-dba3478eb95e admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.018046 Sep 02 17:02:50.458491 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: [pid: 93399|app: 0|req: 26/50] 10.222.0.41 () {60 vars in 1211 bytes} [Thu Sep 2 17:02:50 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:02:50.475542 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-8567f9bd-69a4-437a-b1d1-81e209b56abc admin admin] Calling method '>' {{(pid=93398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:02:50.492724 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.requestlog [None req-8567f9bd-69a4-437a-b1d1-81e209b56abc admin admin] 10.222.0.41 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.022694 Sep 02 17:02:50.493439 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: [pid: 93398|app: 0|req: 25/51] 10.222.0.41 () {60 vars in 1211 bytes} [Thu Sep 2 17:02:50 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:02:50.510718 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-11e6c232-7aaa-4387-ad20-4c529b998f2e admin admin] Calling method '>' {{(pid=93399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:02:50.520447 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.wsgi [None req-11e6c232-7aaa-4387-ad20-4c529b998f2e admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 02 17:02:50.521465 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-11e6c232-7aaa-4387-ad20-4c529b998f2e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=93399) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:02:50.522868 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.requestlog [None req-11e6c232-7aaa-4387-ad20-4c529b998f2e admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.018572 Sep 02 17:02:50.523420 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: [pid: 93399|app: 0|req: 27/52] 10.222.0.41 () {60 vars in 1194 bytes} [Thu Sep 2 17:02:50 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 02 17:02:51.976515 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-8567f9bd-69a4-437a-b1d1-81e209b56abc admin admin] Calling method '>' {{(pid=93398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:02:51.977574 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.requestlog [None req-8567f9bd-69a4-437a-b1d1-81e209b56abc admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Sep 02 17:02:51.977965 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: [pid: 93398|app: 0|req: 26/53] 10.222.0.41 () {56 vars in 1075 bytes} [Thu Sep 2 17:02:51 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:02:52.183021 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-44228908-c3d0-4054-bcd2-6393a647e17b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:02:52.203248 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.requestlog [None req-44228908-c3d0-4054-bcd2-6393a647e17b admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.085429 Sep 02 17:02:52.203796 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: [pid: 93399|app: 0|req: 28/54] 10.222.0.41 () {64 vars in 1236 bytes} [Thu Sep 2 17:02:52 2021] POST /compute/v2.1/flavors => generated 404 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:02:53.591339 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-8567f9bd-69a4-437a-b1d1-81e209b56abc admin admin] Calling method '>' {{(pid=93398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:02:53.592365 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.requestlog [None req-8567f9bd-69a4-437a-b1d1-81e209b56abc admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Sep 02 17:02:53.592763 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: [pid: 93398|app: 0|req: 27/55] 10.222.0.41 () {56 vars in 1075 bytes} [Thu Sep 2 17:02:53 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:02:53.784689 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-637561cb-8a12-4399-a22e-335625a9e6ea admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:02:53.804714 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.requestlog [None req-637561cb-8a12-4399-a22e-335625a9e6ea admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.073885 Sep 02 17:02:53.805266 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: [pid: 93399|app: 0|req: 29/56] 10.222.0.41 () {64 vars in 1236 bytes} [Thu Sep 2 17:02:53 2021] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:02:55.203143 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-8567f9bd-69a4-437a-b1d1-81e209b56abc admin admin] Calling method '>' {{(pid=93398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:02:55.204432 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.requestlog [None req-8567f9bd-69a4-437a-b1d1-81e209b56abc admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001901 Sep 02 17:02:55.205071 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: [pid: 93398|app: 0|req: 28/57] 10.222.0.41 () {56 vars in 1075 bytes} [Thu Sep 2 17:02:55 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:02:55.414256 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-2670ddaa-1076-4052-84e9-b8bf1d11fefa admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:02:55.434236 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.requestlog [None req-2670ddaa-1076-4052-84e9-b8bf1d11fefa admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.077733 Sep 02 17:02:55.434807 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: [pid: 93399|app: 0|req: 30/58] 10.222.0.41 () {64 vars in 1236 bytes} [Thu Sep 2 17:02:55 2021] POST /compute/v2.1/flavors => generated 407 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:02:56.804680 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-8567f9bd-69a4-437a-b1d1-81e209b56abc admin admin] Calling method '>' {{(pid=93398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:02:56.805765 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.requestlog [None req-8567f9bd-69a4-437a-b1d1-81e209b56abc admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Sep 02 17:02:56.806218 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: [pid: 93398|app: 0|req: 29/59] 10.222.0.41 () {56 vars in 1075 bytes} [Thu Sep 2 17:02:56 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:02:57.013372 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-eab40067-6fa0-4d93-9e7b-cb1f5399d9bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:02:57.032510 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.requestlog [None req-eab40067-6fa0-4d93-9e7b-cb1f5399d9bd admin admin] 10.222.0.41 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.076433 Sep 02 17:02:57.033061 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: [pid: 93399|app: 0|req: 31/60] 10.222.0.41 () {64 vars in 1236 bytes} [Thu Sep 2 17:02:56 2021] POST /compute/v2.1/flavors => generated 409 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:02:58.469461 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-8567f9bd-69a4-437a-b1d1-81e209b56abc admin admin] Calling method '>' {{(pid=93398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:02:58.470461 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.requestlog [None req-8567f9bd-69a4-437a-b1d1-81e209b56abc admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Sep 02 17:02:58.470894 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: [pid: 93398|app: 0|req: 30/61] 10.222.0.41 () {56 vars in 1075 bytes} [Thu Sep 2 17:02:58 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:02:58.667962 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-e20f0405-2ba9-4936-81a6-ec7f86decfac admin admin] Calling method '>' {{(pid=93399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:02:58.689324 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.requestlog [None req-e20f0405-2ba9-4936-81a6-ec7f86decfac admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.075926 Sep 02 17:02:58.689874 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: [pid: 93399|app: 0|req: 32/62] 10.222.0.41 () {60 vars in 1203 bytes} [Thu Sep 2 17:02:58 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:03:46.089090 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-8567f9bd-69a4-437a-b1d1-81e209b56abc admin admin] Calling method '>' {{(pid=93398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:03:46.090502 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.requestlog [None req-8567f9bd-69a4-437a-b1d1-81e209b56abc admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Sep 02 17:03:46.090937 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: [pid: 93398|app: 0|req: 31/63] 10.222.0.41 () {54 vars in 931 bytes} [Thu Sep 2 17:03:46 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:03:46.152743 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-cf19e032-627a-4ffe-b8dc-1bae6a4806d6 admin admin] Calling method '>' {{(pid=93399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:03:46.172663 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.requestlog [None req-cf19e032-627a-4ffe-b8dc-1bae6a4806d6 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.075202 Sep 02 17:03:46.173202 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: [pid: 93399|app: 0|req: 33/64] 10.222.0.41 () {60 vars in 1292 bytes} [Thu Sep 2 17:03:46 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:03:46.195302 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-a83678c6-d808-4fb0-8e7e-3079e0888675 admin admin] Calling method '>' {{(pid=93398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:03:46.203339 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.requestlog [None req-a83678c6-d808-4fb0-8e7e-3079e0888675 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011563 Sep 02 17:03:46.203890 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: [pid: 93398|app: 0|req: 32/65] 10.222.0.41 () {60 vars in 1283 bytes} [Thu Sep 2 17:03:46 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:03:46.227208 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-4880823c-65ae-4c9a-9d45-2ed72867f3b0 admin admin] Calling method '>' {{(pid=93399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:03:46.238738 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.requestlog [None req-4880823c-65ae-4c9a-9d45-2ed72867f3b0 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016187 Sep 02 17:03:46.239622 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: [pid: 93399|app: 0|req: 34/66] 10.222.0.41 () {60 vars in 1286 bytes} [Thu Sep 2 17:03:46 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:03:46.261115 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-bcacdfed-a76b-4fd2-9414-c95c307a8ded admin admin] Calling method '>' {{(pid=93398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:03:46.275523 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.requestlog [None req-bcacdfed-a76b-4fd2-9414-c95c307a8ded admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.020774 Sep 02 17:03:46.276541 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: [pid: 93398|app: 0|req: 33/67] 10.222.0.41 () {60 vars in 1286 bytes} [Thu Sep 2 17:03:46 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:03:46.291635 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-e5e3a264-d838-4ccd-a2ce-cb5672102b03 admin admin] Calling method '>' {{(pid=93399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:03:46.300269 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.requestlog [None req-e5e3a264-d838-4ccd-a2ce-cb5672102b03 admin admin] 10.222.0.41 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012238 Sep 02 17:03:46.300816 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: [pid: 93399|app: 0|req: 35/68] 10.222.0.41 () {60 vars in 1283 bytes} [Thu Sep 2 17:03:46 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:05:08.079413 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-b4dbfe05-b769-4b27-a0f2-f1ae8112c76e tempest-verify_tempest_config-942740059 tempest-verify_tempest_config-942740059-project] Calling method '>' {{(pid=93398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:05:08.081455 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.requestlog [None req-b4dbfe05-b769-4b27-a0f2-f1ae8112c76e tempest-verify_tempest_config-942740059 tempest-verify_tempest_config-942740059-project] 10.222.0.41 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.121431 Sep 02 17:05:08.082329 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: [pid: 93398|app: 0|req: 34/69] 10.222.0.41 () {58 vars in 1134 bytes} [Thu Sep 2 17:05:07 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:06:42.087119 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-e5e3a264-d838-4ccd-a2ce-cb5672102b03 admin admin] Calling method '>' {{(pid=93399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:06:42.088140 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.requestlog [None req-e5e3a264-d838-4ccd-a2ce-cb5672102b03 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Sep 02 17:06:42.088548 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: [pid: 93399|app: 0|req: 36/70] 10.222.0.41 () {56 vars in 1075 bytes} [Thu Sep 2 17:06:42 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:06:42.373039 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-a8eab1eb-926d-40b7-aeb5-142e76f21242 admin admin] Calling method '>' {{(pid=93398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:06:42.374229 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:06:42.374229 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: warnings.warn(msg) Sep 02 17:06:42.375817 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG oslo_concurrency.lockutils [None req-a8eab1eb-926d-40b7-aeb5-142e76f21242 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:06:42.376258 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG oslo_concurrency.lockutils [None req-a8eab1eb-926d-40b7-aeb5-142e76f21242 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:06:42.377057 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG oslo_concurrency.lockutils [None req-a8eab1eb-926d-40b7-aeb5-142e76f21242 admin admin] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:06:42.377479 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG oslo_concurrency.lockutils [None req-a8eab1eb-926d-40b7-aeb5-142e76f21242 admin admin] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:06:42.411513 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.requestlog [None req-a8eab1eb-926d-40b7-aeb5-142e76f21242 admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.175603 Sep 02 17:06:42.412071 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: [pid: 93398|app: 0|req: 35/71] 10.222.0.41 () {60 vars in 1194 bytes} [Thu Sep 2 17:06:42 2021] GET /compute/v2.1/os-services => generated 791 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:06:43.802433 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-e5e3a264-d838-4ccd-a2ce-cb5672102b03 admin admin] Calling method '>' {{(pid=93399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:06:43.803771 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.requestlog [None req-e5e3a264-d838-4ccd-a2ce-cb5672102b03 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001643 Sep 02 17:06:43.804157 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: [pid: 93399|app: 0|req: 37/72] 10.222.0.41 () {56 vars in 1075 bytes} [Thu Sep 2 17:06:43 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:06:43.999624 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-e84e319f-a1f8-497c-abbc-61c4548f26e2 admin admin] Calling method '>' {{(pid=93398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:06:44.000791 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:06:44.000791 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: warnings.warn(msg) Sep 02 17:06:44.002342 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG oslo_concurrency.lockutils [None req-e84e319f-a1f8-497c-abbc-61c4548f26e2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:06:44.002815 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG oslo_concurrency.lockutils [None req-e84e319f-a1f8-497c-abbc-61c4548f26e2 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:06:44.003602 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG oslo_concurrency.lockutils [None req-e84e319f-a1f8-497c-abbc-61c4548f26e2 admin admin] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:06:44.004027 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG oslo_concurrency.lockutils [None req-e84e319f-a1f8-497c-abbc-61c4548f26e2 admin admin] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:06:44.024534 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.requestlog [None req-e84e319f-a1f8-497c-abbc-61c4548f26e2 admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.079513 Sep 02 17:06:44.025025 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: [pid: 93398|app: 0|req: 36/73] 10.222.0.41 () {60 vars in 1194 bytes} [Thu Sep 2 17:06:43 2021] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:06:55.879832 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-e5e3a264-d838-4ccd-a2ce-cb5672102b03 admin admin] Calling method '>' {{(pid=93399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:06:55.880841 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.requestlog [None req-e5e3a264-d838-4ccd-a2ce-cb5672102b03 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Sep 02 17:06:55.881245 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: [pid: 93399|app: 0|req: 38/74] 10.222.0.41 () {56 vars in 1075 bytes} [Thu Sep 2 17:06:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:06:56.072739 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-4149f1b3-1734-4eaf-b1c9-4a35e02ba894 admin admin] Calling method '>' {{(pid=93398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:06:56.074474 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:06:56.074474 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: warnings.warn(msg) Sep 02 17:06:56.076019 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG oslo_concurrency.lockutils [None req-4149f1b3-1734-4eaf-b1c9-4a35e02ba894 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:06:56.076453 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG oslo_concurrency.lockutils [None req-4149f1b3-1734-4eaf-b1c9-4a35e02ba894 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:06:56.077234 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG oslo_concurrency.lockutils [None req-4149f1b3-1734-4eaf-b1c9-4a35e02ba894 admin admin] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:06:56.077657 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG oslo_concurrency.lockutils [None req-4149f1b3-1734-4eaf-b1c9-4a35e02ba894 admin admin] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:06:56.101989 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.requestlog [None req-4149f1b3-1734-4eaf-b1c9-4a35e02ba894 admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.080694 Sep 02 17:06:56.102467 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: [pid: 93398|app: 0|req: 37/75] 10.222.0.41 () {60 vars in 1194 bytes} [Thu Sep 2 17:06:56 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:06:57.465508 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: DEBUG nova.api.openstack.wsgi [None req-e5e3a264-d838-4ccd-a2ce-cb5672102b03 admin admin] Calling method '>' {{(pid=93399) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:06:57.466503 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: INFO nova.api.openstack.requestlog [None req-e5e3a264-d838-4ccd-a2ce-cb5672102b03 admin admin] 10.222.0.41 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Sep 02 17:06:57.466946 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: [pid: 93399|app: 0|req: 39/76] 10.222.0.41 () {56 vars in 1075 bytes} [Thu Sep 2 17:06:57 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:06:57.663588 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG nova.api.openstack.wsgi [None req-9579bea8-4948-408b-ab4a-41e52c4e7cf3 admin admin] Calling method '>' {{(pid=93398) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:06:57.664758 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:06:57.664758 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: warnings.warn(msg) Sep 02 17:06:57.666275 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG oslo_concurrency.lockutils [None req-9579bea8-4948-408b-ab4a-41e52c4e7cf3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:06:57.666750 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG oslo_concurrency.lockutils [None req-9579bea8-4948-408b-ab4a-41e52c4e7cf3 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:06:57.668149 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG oslo_concurrency.lockutils [None req-9579bea8-4948-408b-ab4a-41e52c4e7cf3 admin admin] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=93398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:06:57.668571 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: DEBUG oslo_concurrency.lockutils [None req-9579bea8-4948-408b-ab4a-41e52c4e7cf3 admin admin] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93398) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:06:57.689576 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: INFO nova.api.openstack.requestlog [None req-9579bea8-4948-408b-ab4a-41e52c4e7cf3 admin admin] 10.222.0.41 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.077034 Sep 02 17:06:57.690263 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: [pid: 93398|app: 0|req: 38/77] 10.222.0.41 () {60 vars in 1194 bytes} [Thu Sep 2 17:06:57 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:07:57.619721 dv-cinder-806260-3-iscsi devstack@n-api.service[93397]: Thu Sep 2 17:07:57 2021 - graceful shutdown triggered... Sep 02 17:07:57.620273 dv-cinder-806260-3-iscsi devstack@n-api.service[93398]: Gracefully killing worker 1 (pid: 93398)... Sep 02 17:07:57.620665 dv-cinder-806260-3-iscsi devstack@n-api.service[93399]: Gracefully killing worker 2 (pid: 93399)... Sep 02 17:07:57.621232 dv-cinder-806260-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 02 17:07:58.620997 dv-cinder-806260-3-iscsi devstack@n-api.service[93397]: worker 1 buried after 1 seconds Sep 02 17:07:58.620997 dv-cinder-806260-3-iscsi devstack@n-api.service[93397]: worker 2 buried after 1 seconds Sep 02 17:07:58.620997 dv-cinder-806260-3-iscsi devstack@n-api.service[93397]: goodbye to uWSGI. Sep 02 17:07:58.622524 dv-cinder-806260-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 02 17:07:58.623134 dv-cinder-806260-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 02 17:07:58.625905 dv-cinder-806260-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 02 17:07:58.635242 dv-cinder-806260-3-iscsi devstack@n-api.service[108397]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 02 17:07:58.637863 dv-cinder-806260-3-iscsi devstack@n-api.service[108397]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 2 17:07:58 2021] *** Sep 02 17:07:58.638041 dv-cinder-806260-3-iscsi devstack@n-api.service[108397]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 02 17:07:58.638174 dv-cinder-806260-3-iscsi devstack@n-api.service[108397]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 02 17:07:58.638293 dv-cinder-806260-3-iscsi devstack@n-api.service[108397]: nodename: dv-cinder-806260-3-iscsi Sep 02 17:07:58.638402 dv-cinder-806260-3-iscsi devstack@n-api.service[108397]: machine: x86_64 Sep 02 17:07:58.638509 dv-cinder-806260-3-iscsi devstack@n-api.service[108397]: clock source: unix Sep 02 17:07:58.638614 dv-cinder-806260-3-iscsi devstack@n-api.service[108397]: pcre jit disabled Sep 02 17:07:58.638773 dv-cinder-806260-3-iscsi devstack@n-api.service[108397]: detected number of CPU cores: 4 Sep 02 17:07:58.638881 dv-cinder-806260-3-iscsi devstack@n-api.service[108397]: current working directory: / Sep 02 17:07:58.639193 dv-cinder-806260-3-iscsi devstack@n-api.service[108397]: detected binary path: /usr/bin/uwsgi-core Sep 02 17:07:58.639328 dv-cinder-806260-3-iscsi devstack@n-api.service[108397]: your processes number limit is 47680 Sep 02 17:07:58.639439 dv-cinder-806260-3-iscsi devstack@n-api.service[108397]: your memory page size is 4096 bytes Sep 02 17:07:58.639553 dv-cinder-806260-3-iscsi devstack@n-api.service[108397]: detected max file descriptor number: 2048 Sep 02 17:07:58.639667 dv-cinder-806260-3-iscsi devstack@n-api.service[108397]: lock engine: pthread robust mutexes Sep 02 17:07:58.639964 dv-cinder-806260-3-iscsi devstack@n-api.service[108397]: thunder lock: enabled Sep 02 17:07:58.640146 dv-cinder-806260-3-iscsi devstack@n-api.service[108397]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 02 17:07:58.640253 dv-cinder-806260-3-iscsi devstack@n-api.service[108397]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Sep 02 17:07:58.685940 dv-cinder-806260-3-iscsi devstack@n-api.service[108397]: Python main interpreter initialized at 0x5581804109c0 Sep 02 17:07:58.685940 dv-cinder-806260-3-iscsi devstack@n-api.service[108397]: python threads support enabled Sep 02 17:07:58.685940 dv-cinder-806260-3-iscsi devstack@n-api.service[108397]: your server socket listen backlog is limited to 100 connections Sep 02 17:07:58.685940 dv-cinder-806260-3-iscsi devstack@n-api.service[108397]: your mercy for graceful operations on workers is 90 seconds Sep 02 17:07:58.686395 dv-cinder-806260-3-iscsi devstack@n-api.service[108397]: mapped 403077 bytes (393 KB) for 2 cores Sep 02 17:07:58.686395 dv-cinder-806260-3-iscsi devstack@n-api.service[108397]: *** Operational MODE: preforking *** Sep 02 17:07:58.686729 dv-cinder-806260-3-iscsi devstack@n-api.service[108397]: *** uWSGI is running in multiple interpreter mode *** Sep 02 17:07:58.686729 dv-cinder-806260-3-iscsi devstack@n-api.service[108397]: spawned uWSGI master process (pid: 108397) Sep 02 17:07:58.686942 dv-cinder-806260-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 02 17:07:58.687528 dv-cinder-806260-3-iscsi devstack@n-api.service[108397]: spawned uWSGI worker 1 (pid: 108417, cores: 1) Sep 02 17:07:58.688027 dv-cinder-806260-3-iscsi devstack@n-api.service[108397]: spawned uWSGI worker 2 (pid: 108418, cores: 1) Sep 02 17:07:58.688357 dv-cinder-806260-3-iscsi devstack@n-api.service[108397]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 02 17:08:00.522252 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 17:08:00.522252 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: from cryptography.utils import int_from_bytes Sep 02 17:08:00.522947 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 17:08:00.522947 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: from cryptography.utils import int_from_bytes Sep 02 17:08:00.547783 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 17:08:00.547783 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: from cryptography.utils import int_from_bytes Sep 02 17:08:00.548441 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 02 17:08:00.548441 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: from cryptography.utils import int_from_bytes Sep 02 17:08:03.265915 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 02 17:08:03.266494 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 02 17:08:03.266776 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 02 17:08:03.267081 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 02 17:08:03.267345 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 02 17:08:03.267743 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.268084 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.268419 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.268747 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.269087 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.269406 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.269743 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.270066 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.270401 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.270694 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.271025 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.271364 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-806260-3-iscsi {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.271694 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.272009 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.272328 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.272658 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.272973 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.273304 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.273616 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.274128 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.279838 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.279838 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.279838 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.279838 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.279838 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.279838 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.279838 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.279838 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.280513 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.280513 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.280513 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-806260-3-iscsi {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.280513 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.280513 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.280513 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.280513 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.280513 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.281001 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.281001 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.281001 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.281236 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.281401 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.281915 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.282445 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.282982 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.283456 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.283972 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.284454 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.284975 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.285296 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.285617 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.285870 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.286370 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.286734 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.287074 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.287412 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.287695 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.287925 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.288437 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.288771 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.289086 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.289403 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.289721 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.290035 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.290348 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.290687 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.291005 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.291324 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.291652 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.291975 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.292967 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.293287 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.293614 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.294034 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.294293 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.294613 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.294992 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.295314 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.295632 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.295958 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.296287 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.296601 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.296914 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.297226 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.297551 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.297880 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.298190 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.298447 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.298783 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.299096 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.299418 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.299729 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.300039 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.300350 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.300655 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.300965 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.301279 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.301591 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.301905 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.302221 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.302530 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.302869 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.303183 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.303492 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.303820 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.304305 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.304470 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.304753 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.305147 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.305370 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.305699 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.306011 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.306324 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.306672 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.306989 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.307145 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 02 17:08:03.307618 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.307813 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 02 17:08:03.308506 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.308651 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 02 17:08:03.308797 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.308937 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 02 17:08:03.309083 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.309235 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 02 17:08:03.309403 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.309562 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.309723 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.309863 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.310014 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.310163 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.310311 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.310458 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.310597 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.310783 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.310933 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.311079 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.311218 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.311218 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.311531 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.311669 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.311820 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.311977 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.312117 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.312117 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.312383 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.312544 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.312697 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.312697 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.312974 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-806260-3-iscsi {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.313113 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.313341 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.313341 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.313628 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.313784 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.314012 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.314166 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.314546 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.314546 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.314981 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.315234 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.315465 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.315465 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.315758 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.315758 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.316137 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.316314 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.316462 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.316600 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.316746 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.316891 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.317034 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.317172 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.317317 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.317464 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.317612 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.317750 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.317899 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.318062 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.318209 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.318357 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.318505 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.318685 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.318832 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.318971 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.319116 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.319268 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.319409 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-806260-3-iscsi {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.319557 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.319703 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.319849 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.320014 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.320169 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.320309 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.320456 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.320603 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.320742 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.320887 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.321024 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.321163 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.321308 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.321447 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.321592 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.321750 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.321891 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.322035 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.322183 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.322332 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.322489 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.322675 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.322838 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.322979 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.323124 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.323272 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.323589 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.323745 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.323907 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.324137 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.324292 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.324662 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.324831 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.324996 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.325232 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.325549 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.325853 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.326019 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.326019 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.326395 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.326534 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.326723 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.326877 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.327026 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.327165 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.327309 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.327456 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.327598 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.327736 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.327955 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.328097 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.328238 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.328397 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.328539 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.328685 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.328825 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.328962 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.329108 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.329252 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.329390 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.329541 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.329688 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.329836 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.329975 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.330112 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.330112 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.330406 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.330609 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.330803 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.330951 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.331089 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.331235 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.331385 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.331524 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.331662 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.331800 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.331942 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.332094 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.332289 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.332452 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.332596 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.332596 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.332874 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.41 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.332874 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.41 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.333152 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.333290 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.333426 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.333583 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.333798 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.333955 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.334124 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.334342 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.334487 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.334875 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.335041 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.335210 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.335405 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.335682 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.335853 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.336085 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.336255 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.336497 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.336649 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.336806 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.336947 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.336947 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.337293 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.337455 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.337625 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.337766 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.337905 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.338044 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.338195 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.338335 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.338473 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.338793 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.339020 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.339178 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.339333 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.339473 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.339619 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.339759 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.339904 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.349770 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.350053 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.350233 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.350399 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.350553 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.350789 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.350949 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.351101 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.351413 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.351575 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.351717 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.351878 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.352030 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.352180 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.352321 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.352468 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.352613 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.355861 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.356074 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.356256 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.356448 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.356611 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.356755 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.356896 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.357036 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.357194 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.357336 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.357509 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.357657 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.357797 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.357945 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.358105 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.358246 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.358393 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.358542 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.358703 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.358861 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.359254 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.359394 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.359547 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.359694 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.359834 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.359980 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.360121 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.360279 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.360434 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.360593 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.360744 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.360884 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.361023 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.361161 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.361308 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.361455 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.361600 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.361809 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.361955 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.362102 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.362261 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.362402 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.362539 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.362720 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.362873 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.363030 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.363206 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.363206 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.363482 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.363621 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.363759 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.364769 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.364925 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.365087 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.365243 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.365390 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.365538 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.365684 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.365824 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.365970 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.366118 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.366259 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.366405 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.366550 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.366724 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.366877 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.367016 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.367172 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.367391 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.367542 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 02 17:08:03.367690 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.370368 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.371112 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.371282 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.371445 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.371598 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.371745 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.371886 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.372044 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.372204 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.372346 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.372484 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.372623 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.372761 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.372911 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.373068 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.373209 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.373359 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.373499 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.373638 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.373777 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.373945 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.374293 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.374883 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.375036 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.375188 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.375335 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.375484 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.375630 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.375780 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.375928 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.376068 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.376220 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.376371 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.376517 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.376657 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.376797 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.376797 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.376797 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.376797 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.376797 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.376797 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.377580 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.377731 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.377881 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.378044 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.378202 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.378343 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.378489 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.378707 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.378867 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.379015 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.379163 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.379303 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.379441 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.379588 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.379727 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.379867 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.380004 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.380159 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.380299 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.380445 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.380445 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.380445 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.380445 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.380445 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.380445 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.380445 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.380445 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.381491 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.381491 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.381491 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.381491 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.381491 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.381491 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.381491 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.381491 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.382554 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.382832 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.383000 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.383146 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.383293 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.383433 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.383571 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.383735 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.383883 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.384029 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.384195 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.384480 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.385068 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.385229 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.385379 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.385520 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.385659 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.385804 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.385983 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.386134 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.386294 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.386435 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.386582 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.386799 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.386951 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.387091 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.387229 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.387368 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.387514 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.387659 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.387807 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.387953 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.388094 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.388249 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.388389 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.388528 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.388674 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.388821 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.388961 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.389106 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.389246 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.389393 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.389393 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.389677 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.389824 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.389964 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.390114 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.390261 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.390410 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.390568 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.390743 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.390894 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.391045 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.391192 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.391331 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.391470 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.391608 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.391753 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.391753 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.391753 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.391753 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.392295 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.392434 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.392580 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.392776 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.392992 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.393148 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.393295 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.393435 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.393585 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.393738 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.393889 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.394028 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.394256 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.394419 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.394755 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.395325 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.395475 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.395626 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.395626 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.395969 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.396111 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.396258 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.396397 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.396546 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.396699 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.396856 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.397125 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.397271 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.397418 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.397557 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.397705 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.397846 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.397984 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.398130 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.398269 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.398426 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.398580 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.398783 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.398924 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.399071 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.399071 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.399342 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.399489 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.399628 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.399768 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.399905 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.400042 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.400188 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.400337 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.400476 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.400615 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.400753 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.400892 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.401042 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.401181 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.401327 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.401496 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.401650 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.401790 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.401945 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.401945 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.402218 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.402356 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.402494 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.402649 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.402811 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.402952 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.402952 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.403232 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.403381 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.403533 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.403673 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.403811 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.403948 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.404104 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.404252 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.404404 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.404543 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.404857 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.405452 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.405608 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.405762 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.405924 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.406066 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.406213 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.406360 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.406525 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.406525 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.406836 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.406978 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.407134 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.407359 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.407504 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.407649 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.407803 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.407943 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.408089 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.408236 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.408374 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.408537 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.408677 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.408815 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.408952 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.409104 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.409258 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.409412 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.409565 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.409712 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.409865 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.410018 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.410164 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.410318 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.410480 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.410716 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.410871 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.411029 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.411176 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.411331 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.411477 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.411628 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.411774 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.411919 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.412077 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.412077 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.412355 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.412517 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.412664 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.412817 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.412977 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.413126 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.413278 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.413425 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.413425 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.413698 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.413852 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.413998 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.414143 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.414295 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.414463 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.414618 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.414987 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.415146 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.415660 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.415827 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.415983 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.416137 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.416283 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.416437 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.416584 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.416728 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.416880 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.417050 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.417819 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.417981 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.418138 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.418291 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.418443 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.418602 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.418878 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.419037 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.419185 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.419337 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.419482 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.419647 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.419795 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.419947 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.420106 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.420265 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.420480 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.420636 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.420783 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.420936 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.421082 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.421227 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.421385 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.421532 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.421697 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.421851 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.421996 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.422142 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.422295 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.422441 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.422593 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.422764 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.422921 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.423068 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.423223 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.423369 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.423528 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.423528 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.423826 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.423972 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.424128 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.424274 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.424424 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.424577 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.424729 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.424883 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.425204 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.425390 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.425837 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.425992 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.426149 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.426361 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.426516 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.426716 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.426870 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.427014 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.427167 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.427321 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.427467 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.427611 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.427755 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.427999 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.428159 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.428326 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.428483 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.428637 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.428898 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.429114 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.429351 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.429538 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.429738 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.429972 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.430196 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.430430 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.430714 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.430982 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.431219 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.431450 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.431675 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.431904 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.432155 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.432396 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.432631 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.432908 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.433620 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.433860 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.434099 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.434330 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.434580 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.434852 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.435093 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.435647 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.436241 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.436441 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.436600 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.436747 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.436894 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.437049 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.437203 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.437351 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.437504 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.437668 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.437668 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.437988 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.438252 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.438414 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.438562 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.438762 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.438910 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.439156 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.439362 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.439513 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.439668 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.439668 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.439980 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.440135 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.440282 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.440434 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.440588 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.440736 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.440894 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.441047 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.441200 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.441346 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.441491 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.441644 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.441813 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.441961 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.442107 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.442259 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.442405 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.442551 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.442832 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.442832 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.443159 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.443307 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.443450 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.443618 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.443806 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.443975 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.444129 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.444276 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.444428 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.444632 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.444826 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.444979 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.445140 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.445288 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.445451 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.445771 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.446114 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.446438 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.446614 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.446787 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.446934 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.447082 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.447227 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.447383 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.447539 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.447692 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.447838 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.447990 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.448137 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.448410 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.448587 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.448587 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.448587 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.448999 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.449152 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.449299 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.449453 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.449601 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.449747 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.449900 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.450054 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.450215 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.450364 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.450520 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.450743 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.450912 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.451066 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.451226 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.451226 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.451519 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.451519 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.451796 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.451941 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.452094 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.452242 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.452386 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.452548 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.452695 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.452852 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.453010 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.453010 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.453295 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.453441 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.453604 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.453758 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.453903 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.454050 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.454202 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.454358 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.454512 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.454689 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.454849 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.454997 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.455143 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.455301 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.455448 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.455606 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.455962 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.456525 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.456681 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.456836 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.456993 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.457148 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.457302 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.457450 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.457603 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.457756 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.457911 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.457911 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.458204 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.458368 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.458610 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.458823 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.459053 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.459215 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.459370 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.459517 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.459671 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.459825 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.459981 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.460127 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.460279 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.460425 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.460578 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.460724 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.460883 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.461037 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.461193 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.461339 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.461491 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.461645 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.461793 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.461938 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.462089 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.462242 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.462389 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.462547 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.462881 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.463043 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.463200 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.463345 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.463505 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.463667 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.463822 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.463999 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.464173 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.464446 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.464626 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.464815 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.464965 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.465117 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.465264 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.465424 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.465586 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.465740 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.465913 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.466238 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.466715 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.466875 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.467040 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.467187 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.467333 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.467485 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.467631 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.467775 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.467946 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.467946 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.468224 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.468368 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.468513 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.468513 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.468907 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.469056 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.469208 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.469361 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.469509 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.469668 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.469815 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.469970 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.470118 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.470268 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.470414 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.470573 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.470763 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.470910 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.471056 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.471242 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.471392 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.471554 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.471709 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.471866 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.472020 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.472167 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.472326 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.472473 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.472618 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.472762 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.472907 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.473052 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.473207 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.473361 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.473514 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.473663 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.473819 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.473972 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.473972 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.474263 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.474408 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.474560 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.474761 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.474917 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.474917 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.475220 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.475377 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.475523 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.475676 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.475840 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.475987 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.476286 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.476458 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.476889 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.477059 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.477209 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.477355 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.477508 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.477663 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.477810 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.477965 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.478111 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.478274 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.478428 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.478575 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.478776 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.479000 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.479158 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.479304 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.479457 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.480142 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.480308 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.480463 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.480618 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.480783 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.480937 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.481084 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.481238 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.481412 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.481621 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.481782 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.481936 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.482169 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.482326 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.482431 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.482509 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.482844 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.482993 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.483136 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.483273 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.483408 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.483538 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.483673 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.483800 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.484194 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.484323 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.484449 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.484449 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.484685 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.484825 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.484953 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.485078 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.485210 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.485343 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.485343 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.485601 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.485729 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.485729 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.485980 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.486114 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.486414 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.486559 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.486559 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.487163 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.487295 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.487421 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.487555 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.487555 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.487803 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.487931 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.487931 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.488168 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.488306 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.488306 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.488545 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.488670 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.488803 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.488932 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.488932 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.489285 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.489412 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.489412 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.489656 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.489783 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.489783 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.490030 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.490156 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.490281 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.490413 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.490413 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.490709 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.490846 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.490979 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.491106 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.491106 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.491352 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.491479 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.491479 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.491715 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.491839 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.491963 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.492097 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.492097 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.492343 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.492475 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.492475 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.492721 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.492859 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.492987 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.493122 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.493122 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.493379 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.493521 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.493656 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.493783 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.493783 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.494029 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.494181 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.494181 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.494479 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.494605 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.494785 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.494990 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.494990 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.495437 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.495627 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.495812 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.496014 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.496014 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.496396 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.496853 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.496853 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.497825 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.498035 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.498035 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.498035 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.498603 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.498603 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.499677 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.499891 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.499891 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.500273 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.500469 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.500662 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.500854 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.501049 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.501243 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.501450 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.501661 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.501849 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.501990 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.502117 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.502252 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.502388 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.502515 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.502668 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.502796 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.502922 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.503067 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.503196 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.503321 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.503453 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.503583 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.503717 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.503851 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.503978 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.504109 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.504244 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.504370 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.504495 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.504628 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.504763 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.504890 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.505015 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.505139 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.505272 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.505410 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.505537 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.505669 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.505803 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.505929 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.506067 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.506193 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.506328 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.506461 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.506596 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.506988 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.507140 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.507140 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.507795 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.507928 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.508061 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.508187 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.508324 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.508451 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.508451 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.508712 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.508852 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.508979 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.509112 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.509245 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.509378 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.509503 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.509643 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.509860 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.510009 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.510009 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.510318 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.510445 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.510580 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.510735 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.510898 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.511030 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.511156 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.511289 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.511414 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.511548 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.511674 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.511799 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.511932 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.512067 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.512201 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.512329 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.512455 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.512626 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.512626 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.512866 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.513006 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.513148 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.513281 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.513407 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.513532 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.513532 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.513784 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.513917 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.514044 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.514177 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.514303 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.514428 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.514613 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.514791 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.514925 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.515059 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.515185 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.515323 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.515456 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.515589 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.515722 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.515855 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.515987 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.516195 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.516331 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.516458 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.516584 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.516710 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.516849 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.517141 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.517274 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.517413 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.517706 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.517987 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.518131 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.518268 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.518395 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.518395 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.518657 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.518800 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.518936 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.519069 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.519196 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.519196 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.519443 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.519569 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.519707 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.519856 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.520055 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.520193 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.520320 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.520454 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.520591 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.520725 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.520852 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.521008 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.521138 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.521438 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.521664 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.521888 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.522193 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.522323 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.522744 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.522936 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.523205 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.523471 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.523643 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.523972 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.524103 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.524438 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.524580 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.524881 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.525021 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.525351 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.525518 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.525803 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.526082 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.526220 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.527165 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.527319 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.527706 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.527856 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.528136 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.528264 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.528451 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.528738 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.528890 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.529278 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.529409 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.529803 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.529946 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.530333 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.530474 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.530603 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.530839 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.531044 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.531376 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.531520 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.531892 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.532029 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.532363 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.532494 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.532808 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.532946 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.533246 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.533482 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.533680 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.533985 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.534124 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.534533 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.534785 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.535110 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.535240 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.535612 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.535756 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.536057 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.536186 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.536919 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.537053 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.537285 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.537488 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.537618 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.537926 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.538073 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.538394 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.538523 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.538776 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.538940 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.539315 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.539481 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.539806 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.539937 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.540252 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.540407 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.540702 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.540843 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.541153 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.541282 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.541581 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.541804 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.542024 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.542980 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.543119 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.543469 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.543719 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.544035 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.544175 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.544577 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.544721 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.545069 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.545208 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.545518 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.545650 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.545957 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.546129 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.546386 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.546661 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.546857 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.547217 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.547486 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.547705 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.547851 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.548182 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.548512 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.548647 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.548785 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.548921 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.549263 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.549479 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.549753 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.549914 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.550294 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.550704 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.550940 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.551086 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.551222 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.551381 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.551642 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.551963 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.552106 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.552465 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.552610 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.552778 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.553019 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.553154 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.553476 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.553607 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.553788 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.554100 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.554230 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.554422 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.554565 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108417) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 02 17:08:03.554822 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.555181 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.555447 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.555763 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.556073 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.556388 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.556697 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.557011 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.557319 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.557649 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.557998 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.558304 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.558616 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.558942 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.559268 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.559583 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.559898 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.560250 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.560571 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.561149 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.561641 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.561828 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.562180 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.562523 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.562867 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.563177 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.563485 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.563810 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.564123 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.564468 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.564776 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.565088 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.565399 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.565711 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.566022 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.566331 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.566675 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.567002 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.567322 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.567660 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.567957 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.568350 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.568739 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.568884 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.569195 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.569508 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.569826 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.570159 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.570474 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.570807 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.571281 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.571556 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.571877 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.572199 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.572577 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.572898 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.573216 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.573546 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.573932 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.574252 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.574598 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.575015 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.575350 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.575675 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.575982 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.576288 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.576595 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.576908 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.577244 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.577560 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.577885 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.578198 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.578556 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.578986 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.579142 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.579461 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.579836 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.580088 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.580419 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.580729 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.581024 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.581343 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.581715 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.582027 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.582379 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.582690 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.583017 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.583320 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.583644 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.583960 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.584284 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.585703 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.585703 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.585703 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.585703 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.586898 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.586898 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.586898 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.586898 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.587388 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.587388 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.587715 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.588044 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.588418 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.588782 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.589638 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.589981 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.590311 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 02 17:08:03.590555 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 02 17:08:03.591747 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_db.sqlalchemy.engines [None req-c36f3ca7-5275-42de-a291-4497a461362a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108417) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 17:08:03.613597 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_db.sqlalchemy.engines [None req-1911db46-1b4c-4ea6-a906-16f9964c001a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108418) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 17:08:03.676685 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.context [None req-c36f3ca7-5275-42de-a291-4497a461362a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3e42ac8c-9d05-40cd-947b-9719402da6b0(cell1) {{(pid=108417) load_cells /opt/stack/nova/nova/context.py:464}} Sep 02 17:08:03.681006 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c36f3ca7-5275-42de-a291-4497a461362a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:03.682806 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c36f3ca7-5275-42de-a291-4497a461362a None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:03.683694 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c36f3ca7-5275-42de-a291-4497a461362a None None] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:03.685672 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c36f3ca7-5275-42de-a291-4497a461362a None None] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:03.696897 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.context [None req-1911db46-1b4c-4ea6-a906-16f9964c001a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3e42ac8c-9d05-40cd-947b-9719402da6b0(cell1) {{(pid=108418) load_cells /opt/stack/nova/nova/context.py:464}} Sep 02 17:08:03.697158 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_db.sqlalchemy.engines [None req-c36f3ca7-5275-42de-a291-4497a461362a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108417) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 17:08:03.698641 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_db.sqlalchemy.engines [None req-c36f3ca7-5275-42de-a291-4497a461362a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108417) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 17:08:03.701590 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1911db46-1b4c-4ea6-a906-16f9964c001a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:03.703580 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1911db46-1b4c-4ea6-a906-16f9964c001a None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:03.704456 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1911db46-1b4c-4ea6-a906-16f9964c001a None None] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:03.706469 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1911db46-1b4c-4ea6-a906-16f9964c001a None None] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:03.717903 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_db.sqlalchemy.engines [None req-1911db46-1b4c-4ea6-a906-16f9964c001a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108418) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 17:08:03.718796 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_db.sqlalchemy.engines [None req-1911db46-1b4c-4ea6-a906-16f9964c001a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108418) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 17:08:03.969507 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_db.sqlalchemy.engines [None req-c36f3ca7-5275-42de-a291-4497a461362a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108417) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 17:08:04.004885 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_db.sqlalchemy.engines [None req-1911db46-1b4c-4ea6-a906-16f9964c001a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108418) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 02 17:08:04.299462 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: WARNING keystonemiddleware.auth_token [None req-c36f3ca7-5275-42de-a291-4497a461362a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 17:08:04.306201 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: WARNING keystonemiddleware.auth_token [None req-c36f3ca7-5275-42de-a291-4497a461362a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 17:08:04.338434 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: WARNING keystonemiddleware.auth_token [None req-1911db46-1b4c-4ea6-a906-16f9964c001a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 17:08:04.345325 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: WARNING keystonemiddleware.auth_token [None req-1911db46-1b4c-4ea6-a906-16f9964c001a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 17:08:04.660055 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: WARNING keystonemiddleware.auth_token [None req-c36f3ca7-5275-42de-a291-4497a461362a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 17:08:04.665388 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: WARNING keystonemiddleware.auth_token [None req-c36f3ca7-5275-42de-a291-4497a461362a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 17:08:04.671402 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5581804109c0 pid: 108417 (default app) Sep 02 17:08:04.703955 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: WARNING keystonemiddleware.auth_token [None req-1911db46-1b4c-4ea6-a906-16f9964c001a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 02 17:08:04.709378 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: WARNING keystonemiddleware.auth_token [None req-1911db46-1b4c-4ea6-a906-16f9964c001a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 02 17:08:04.714775 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5581804109c0 pid: 108418 (default app) Sep 02 17:08:38.879711 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-d89c7856-c1d6-4a42-9950-ddeaf8f940e7 tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] Action: 'create', calling method: .version_select at 0x7fca9a3958b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-322717588"}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:08:38.979818 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-f7b10110-1d9b-4c93-9be6-48a7ec30f1b7 tempest-VolumesGetTestJSON-946075151 tempest-VolumesGetTestJSON-946075151-project] Action: 'create', calling method: .version_select at 0x7fca9a3978b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2071428054", "metadata": {"Type": "work"}}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:08:40.328852 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-d89c7856-c1d6-4a42-9950-ddeaf8f940e7 tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.577075 Sep 02 17:08:40.336145 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 1/1] 10.222.0.41 () {60 vars in 1155 bytes} [Thu Sep 2 17:08:37 2021] POST /compute/v2.1/os-volumes => generated 344 bytes in 2586 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 02 17:08:40.429141 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-f7b10110-1d9b-4c93-9be6-48a7ec30f1b7 tempest-VolumesGetTestJSON-946075151 tempest-VolumesGetTestJSON-946075151-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.318090 Sep 02 17:08:40.430128 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 1/2] 10.222.0.41 () {60 vars in 1156 bytes} [Thu Sep 2 17:08:38 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 2321 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 02 17:08:40.436017 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-fbea9929-b6ba-4c41-bab1-d6a7b824cf59 tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] Calling method '.version_select at 0x7fca9a261310>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:40.587063 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-fbea9929-b6ba-4c41-bab1-d6a7b824cf59 tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/0796e8f6-384e-4c21-a31a-1a3cb05d0148" status: 200 len: 344 microversion: 2.1 time: 0.154685 Sep 02 17:08:40.588771 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 2/3] 10.222.0.41 () {58 vars in 1245 bytes} [Thu Sep 2 17:08:40 2021] GET /compute/v2.1/os-volumes/0796e8f6-384e-4c21-a31a-1a3cb05d0148 => generated 344 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:08:40.598993 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-48dcaac0-9785-407e-96ee-4ff2246b44d1 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2012801169", "imageRef": "22ce6e29-f3a7-49f0-b93a-ddbffa14e44e", "flavorRef": "452", "networks": [{"uuid": "42e64c23-8d50-4a89-acaf-802979ed9882"}]}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:08:40.602516 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-75c0cc53-7f66-4d10-a9b0-fdf616e866cc tempest-VolumesGetTestJSON-946075151 tempest-VolumesGetTestJSON-946075151-project] Calling method '.version_select at 0x7fca9a261af0>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:40.746699 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-75c0cc53-7f66-4d10-a9b0-fdf616e866cc tempest-VolumesGetTestJSON-946075151 tempest-VolumesGetTestJSON-946075151-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/863df15f-1ab3-410d-8f25-a6ab4244d117" status: 200 len: 353 microversion: 2.1 time: 0.156011 Sep 02 17:08:40.751786 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 3/4] 10.222.0.41 () {58 vars in 1245 bytes} [Thu Sep 2 17:08:40 2021] GET /compute/v2.1/os-volumes/863df15f-1ab3-410d-8f25-a6ab4244d117 => generated 353 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:08:40.865614 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.network.neutron [None req-48dcaac0-9785-407e-96ee-4ff2246b44d1 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] validate_networks() for [('42e64c23-8d50-4a89-acaf-802979ed9882', None, None, None, None, None)] {{(pid=108417) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 17:08:41.335978 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-db006eda-909d-41bc-9319-b682d99f8e6d tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1134926637", "imageRef": "22ce6e29-f3a7-49f0-b93a-ddbffa14e44e", "flavorRef": "452", "networks": [{"uuid": "87d155fe-60da-4839-b7eb-22a29138d9b5"}]}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:08:41.554344 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.network.neutron [None req-db006eda-909d-41bc-9319-b682d99f8e6d tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] validate_networks() for [('87d155fe-60da-4839-b7eb-22a29138d9b5', None, None, None, None, None)] {{(pid=108418) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 17:08:42.049069 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-48dcaac0-9785-407e-96ee-4ff2246b44d1 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Flavor limits 0:0:0 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 17:08:42.050928 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-48dcaac0-9785-407e-96ee-4ff2246b44d1 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Image limits 0:0:0 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 17:08:42.051662 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-48dcaac0-9785-407e-96ee-4ff2246b44d1 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Flavor pref 0:0:0 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 17:08:42.052484 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-48dcaac0-9785-407e-96ee-4ff2246b44d1 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Image pref 0:0:0 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 17:08:42.053147 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-48dcaac0-9785-407e-96ee-4ff2246b44d1 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 17:08:42.096253 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-48dcaac0-9785-407e-96ee-4ff2246b44d1 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:42.096866 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-48dcaac0-9785-407e-96ee-4ff2246b44d1 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:42.098738 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-48dcaac0-9785-407e-96ee-4ff2246b44d1 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:42.099289 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-48dcaac0-9785-407e-96ee-4ff2246b44d1 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:42.167657 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.quota [None req-48dcaac0-9785-407e-96ee-4ff2246b44d1 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Getting quotas for project 9ec1c77ded4a41158a99f6cf578e395e. Resources: {'instances', 'cores', 'ram'} {{(pid=108417) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 17:08:42.187345 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.quota [None req-48dcaac0-9785-407e-96ee-4ff2246b44d1 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Getting quotas for user 86d5b6fd03e140b3bfbfef7a087063ec and project 9ec1c77ded4a41158a99f6cf578e395e. Resources: {'instances', 'cores', 'ram'} {{(pid=108417) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 17:08:42.205462 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-48dcaac0-9785-407e-96ee-4ff2246b44d1 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Going to run 1 instances... {{(pid=108417) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 17:08:42.209965 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-48dcaac0-9785-407e-96ee-4ff2246b44d1 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22ce6e29-f3a7-49f0-b93a-ddbffa14e44e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108417) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 17:08:42.450815 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-48dcaac0-9785-407e-96ee-4ff2246b44d1 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.112293 Sep 02 17:08:42.453302 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 2/5] 10.222.0.41 () {60 vars in 1147 bytes} [Thu Sep 2 17:08:40 2021] POST /compute/v2.1/servers => generated 380 bytes in 2116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 17:08:42.460222 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-93b2351a-d2ca-4ec2-ac68-737837b37f68 tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] Calling method '.version_select at 0x7fca99972a60>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:42.543488 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-93b2351a-d2ca-4ec2-ac68-737837b37f68 tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/0796e8f6-384e-4c21-a31a-1a3cb05d0148" status: 200 len: 345 microversion: 2.1 time: 0.087669 Sep 02 17:08:42.544346 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 3/6] 10.222.0.41 () {58 vars in 1245 bytes} [Thu Sep 2 17:08:42 2021] GET /compute/v2.1/os-volumes/0796e8f6-384e-4c21-a31a-1a3cb05d0148 => generated 345 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:08:42.556276 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-6c06a3b8-cac9-42f9-8e5b-ea1ee37874b4 tempest-VolumesGetTestJSON-946075151 tempest-VolumesGetTestJSON-946075151-project] Calling method '.version_select at 0x7fca99984700>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:42.658414 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-6c06a3b8-cac9-42f9-8e5b-ea1ee37874b4 tempest-VolumesGetTestJSON-946075151 tempest-VolumesGetTestJSON-946075151-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/863df15f-1ab3-410d-8f25-a6ab4244d117" status: 200 len: 354 microversion: 2.1 time: 0.112803 Sep 02 17:08:42.659193 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 4/7] 10.222.0.41 () {58 vars in 1245 bytes} [Thu Sep 2 17:08:42 2021] GET /compute/v2.1/os-volumes/863df15f-1ab3-410d-8f25-a6ab4244d117 => generated 354 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:08:42.664723 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-1969a867-f5fd-4f69-bc4d-71f56f03b7a0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:42.665707 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-1969a867-f5fd-4f69-bc4d-71f56f03b7a0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:08:42.894551 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-1969a867-f5fd-4f69-bc4d-71f56f03b7a0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:08:42.927340 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-1969a867-f5fd-4f69-bc4d-71f56f03b7a0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97" status: 200 len: 1218 microversion: 2.1 time: 0.266126 Sep 02 17:08:42.928271 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 5/8] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:08:42 2021] GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 => generated 1218 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:08:42.933213 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-cc9b77c2-48c4-48bb-a8a7-136207aa0179 tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] Action: 'create', calling method: .version_select at 0x7fca9911c5e0>, body: {"snapshot": {"volume_id": "0796e8f6-384e-4c21-a31a-1a3cb05d0148", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1758512422"}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:08:43.268016 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-db006eda-909d-41bc-9319-b682d99f8e6d tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Flavor limits 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 17:08:43.268568 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-db006eda-909d-41bc-9319-b682d99f8e6d tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Image limits 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 17:08:43.268889 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-db006eda-909d-41bc-9319-b682d99f8e6d tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Flavor pref 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 17:08:43.269284 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-db006eda-909d-41bc-9319-b682d99f8e6d tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Image pref 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 17:08:43.270028 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-db006eda-909d-41bc-9319-b682d99f8e6d tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 17:08:43.305126 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-db006eda-909d-41bc-9319-b682d99f8e6d tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:43.306290 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-db006eda-909d-41bc-9319-b682d99f8e6d tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:43.308908 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-db006eda-909d-41bc-9319-b682d99f8e6d tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:43.310925 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-db006eda-909d-41bc-9319-b682d99f8e6d tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:43.408277 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.quota [None req-db006eda-909d-41bc-9319-b682d99f8e6d tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Getting quotas for project 39e70c9c6e0d4dc8ad9911fa97233da1. Resources: {'instances', 'cores', 'ram'} {{(pid=108418) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 17:08:43.425036 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.quota [None req-db006eda-909d-41bc-9319-b682d99f8e6d tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Getting quotas for user 0551e3470b724193ade42d712dfcca04 and project 39e70c9c6e0d4dc8ad9911fa97233da1. Resources: {'instances', 'cores', 'ram'} {{(pid=108418) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 17:08:43.463958 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-db006eda-909d-41bc-9319-b682d99f8e6d tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Going to run 1 instances... {{(pid=108418) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 17:08:43.469174 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-db006eda-909d-41bc-9319-b682d99f8e6d tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] [instance: 731fe663-d306-40c9-bc5b-af255b67d8d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22ce6e29-f3a7-49f0-b93a-ddbffa14e44e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108418) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 17:08:43.493486 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-cc9b77c2-48c4-48bb-a8a7-136207aa0179 tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] 10.222.0.41 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.563533 Sep 02 17:08:43.500270 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 6/9] 10.222.0.41 () {60 vars in 1162 bytes} [Thu Sep 2 17:08:42 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:08:43.509447 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-9c7c1b12-fbd7-4d58-a7de-01e70463d8b4 tempest-VolumesGetTestJSON-946075151 tempest-VolumesGetTestJSON-946075151-project] Calling method '.version_select at 0x7fca9911c550>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:43.610562 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-9c7c1b12-fbd7-4d58-a7de-01e70463d8b4 tempest-VolumesGetTestJSON-946075151 tempest-VolumesGetTestJSON-946075151-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/863df15f-1ab3-410d-8f25-a6ab4244d117" status: 200 len: 354 microversion: 2.1 time: 0.108794 Sep 02 17:08:43.611411 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 7/10] 10.222.0.41 () {58 vars in 1245 bytes} [Thu Sep 2 17:08:43 2021] GET /compute/v2.1/os-volumes/863df15f-1ab3-410d-8f25-a6ab4244d117 => generated 354 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:08:43.619759 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-70150f87-96f7-43d7-89f6-3a5925332ef4 tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] Calling method '.version_select at 0x7fca991324c0>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:43.662153 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-70150f87-96f7-43d7-89f6-3a5925332ef4 tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/0199b74d-60c5-4027-a319-3ef773987af3" status: 200 len: 287 microversion: 2.1 time: 0.046715 Sep 02 17:08:43.662753 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 8/11] 10.222.0.41 () {58 vars in 1251 bytes} [Thu Sep 2 17:08:43 2021] GET /compute/v2.1/os-snapshots/0199b74d-60c5-4027-a319-3ef773987af3 => generated 287 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:08:43.673530 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-e809760a-5bad-4d10-96df-1eddc790fbf6 tempest-VolumesGetTestJSON-946075151 tempest-VolumesGetTestJSON-946075151-project] Calling method '.version_select at 0x7fca9913c0d0>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:43.737285 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-db006eda-909d-41bc-9319-b682d99f8e6d tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.687463 Sep 02 17:08:43.737929 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 4/12] 10.222.0.41 () {60 vars in 1147 bytes} [Thu Sep 2 17:08:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 2689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 17:08:43.749319 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-a1a5ce7f-2b4e-48d7-a9f9-743aac1ec444 tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] Calling method '.version_select at 0x7fca99972ca0>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:43.810335 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-e809760a-5bad-4d10-96df-1eddc790fbf6 tempest-VolumesGetTestJSON-946075151 tempest-VolumesGetTestJSON-946075151-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/863df15f-1ab3-410d-8f25-a6ab4244d117" status: 202 len: 0 microversion: 2.1 time: 0.140463 Sep 02 17:08:43.811872 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 9/13] 10.222.0.41 () {58 vars in 1248 bytes} [Thu Sep 2 17:08:43 2021] DELETE /compute/v2.1/os-volumes/863df15f-1ab3-410d-8f25-a6ab4244d117 => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:08:43.817082 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-a7fdbec9-a219-4156-94d0-1dafe3f994ac tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:43.818036 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-a7fdbec9-a219-4156-94d0-1dafe3f994ac tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] [instance: 731fe663-d306-40c9-bc5b-af255b67d8d8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:08:43.836903 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-a1a5ce7f-2b4e-48d7-a9f9-743aac1ec444 tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.097754 Sep 02 17:08:43.839153 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 5/14] 10.222.0.41 () {58 vars in 1140 bytes} [Thu Sep 2 17:08:43 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:08:43.843847 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-ea0fedc6-97bd-490e-844a-213e6d9fdf83 tempest-VolumesGetTestJSON-946075151 tempest-VolumesGetTestJSON-946075151-project] Calling method '.version_select at 0x7fca999880d0>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:44.013300 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-ea0fedc6-97bd-490e-844a-213e6d9fdf83 tempest-VolumesGetTestJSON-946075151 tempest-VolumesGetTestJSON-946075151-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/863df15f-1ab3-410d-8f25-a6ab4244d117" status: 200 len: 353 microversion: 2.1 time: 0.172793 Sep 02 17:08:44.014115 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 6/15] 10.222.0.41 () {58 vars in 1245 bytes} [Thu Sep 2 17:08:43 2021] GET /compute/v2.1/os-volumes/863df15f-1ab3-410d-8f25-a6ab4244d117 => generated 353 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:08:44.018728 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-a33b1061-ef94-48d9-90e2-6f7b0c56f28c tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] Calling method '.version_select at 0x7fca99988b80>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:44.083594 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-a33b1061-ef94-48d9-90e2-6f7b0c56f28c tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/0199b74d-60c5-4027-a319-3ef773987af3" status: 200 len: 287 microversion: 2.1 time: 0.068154 Sep 02 17:08:44.084367 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 7/16] 10.222.0.41 () {58 vars in 1251 bytes} [Thu Sep 2 17:08:44 2021] GET /compute/v2.1/os-snapshots/0199b74d-60c5-4027-a319-3ef773987af3 => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:08:44.093167 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-5ef2fa38-f9e6-4240-b32f-d9b54c9714a4 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:44.094029 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-5ef2fa38-f9e6-4240-b32f-d9b54c9714a4 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:08:44.201810 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-a7fdbec9-a219-4156-94d0-1dafe3f994ac tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0551e3470b724193ade42d712dfcca04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e70c9c6e0d4dc8ad9911fa97233da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:08:44.211663 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-a7fdbec9-a219-4156-94d0-1dafe3f994ac tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] 10.222.0.41 "GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8" status: 200 len: 1215 microversion: 2.1 time: 0.398158 Sep 02 17:08:44.213708 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 10/17] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:08:43 2021] GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8 => generated 1215 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:08:44.449860 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-5ef2fa38-f9e6-4240-b32f-d9b54c9714a4 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:08:44.478169 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-5ef2fa38-f9e6-4240-b32f-d9b54c9714a4 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97" status: 200 len: 1218 microversion: 2.1 time: 0.388449 Sep 02 17:08:44.488659 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 8/18] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:08:44 2021] GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 => generated 1218 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:08:45.026914 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-bc2bac1b-430e-4e75-8af6-09dab1fa4781 tempest-VolumesGetTestJSON-946075151 tempest-VolumesGetTestJSON-946075151-project] Calling method '.version_select at 0x7fca99132430>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:45.095637 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-76024b50-84f4-4a40-84e0-6a211d491277 tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] Calling method '.version_select at 0x7fca9998b670>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:45.134345 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-bc2bac1b-430e-4e75-8af6-09dab1fa4781 tempest-VolumesGetTestJSON-946075151 tempest-VolumesGetTestJSON-946075151-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/863df15f-1ab3-410d-8f25-a6ab4244d117" status: 200 len: 353 microversion: 2.1 time: 0.112263 Sep 02 17:08:45.140432 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 11/19] 10.222.0.41 () {58 vars in 1245 bytes} [Thu Sep 2 17:08:45 2021] GET /compute/v2.1/os-volumes/863df15f-1ab3-410d-8f25-a6ab4244d117 => generated 353 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:08:45.141108 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-76024b50-84f4-4a40-84e0-6a211d491277 tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/0199b74d-60c5-4027-a319-3ef773987af3" status: 200 len: 287 microversion: 2.1 time: 0.049197 Sep 02 17:08:45.145467 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 9/20] 10.222.0.41 () {58 vars in 1251 bytes} [Thu Sep 2 17:08:45 2021] GET /compute/v2.1/os-snapshots/0199b74d-60c5-4027-a319-3ef773987af3 => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:08:45.242800 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-b0e743cf-4e49-4919-b98a-310238d804e4 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:45.243435 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-b0e743cf-4e49-4919-b98a-310238d804e4 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] [instance: 731fe663-d306-40c9-bc5b-af255b67d8d8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:08:45.433070 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-b0e743cf-4e49-4919-b98a-310238d804e4 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0551e3470b724193ade42d712dfcca04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e70c9c6e0d4dc8ad9911fa97233da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:08:45.455866 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-b0e743cf-4e49-4919-b98a-310238d804e4 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] 10.222.0.41 "GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8" status: 200 len: 1215 microversion: 2.1 time: 0.227957 Sep 02 17:08:45.456721 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 12/21] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:08:45 2021] GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8 => generated 1215 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:08:45.496393 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-303b89db-27b6-4bc7-b65c-718db17e5e0d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:45.498152 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-303b89db-27b6-4bc7-b65c-718db17e5e0d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:08:45.513505 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-303b89db-27b6-4bc7-b65c-718db17e5e0d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:45.515244 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-303b89db-27b6-4bc7-b65c-718db17e5e0d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:45.516935 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-303b89db-27b6-4bc7-b65c-718db17e5e0d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:45.517656 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-303b89db-27b6-4bc7-b65c-718db17e5e0d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:45.772564 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-303b89db-27b6-4bc7-b65c-718db17e5e0d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:08:45.787817 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-303b89db-27b6-4bc7-b65c-718db17e5e0d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97" status: 200 len: 1222 microversion: 2.1 time: 0.295495 Sep 02 17:08:45.798400 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 10/22] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:08:45 2021] GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 => generated 1222 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:08:46.162246 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-007c012a-8cbc-4da1-94d1-be6f1abecdcb tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] Calling method '.version_select at 0x7fca9909edc0>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:46.164200 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-bf95f808-c160-43f6-bc2e-260ac5139f1d tempest-VolumesGetTestJSON-946075151 tempest-VolumesGetTestJSON-946075151-project] Calling method '.version_select at 0x7fca99132550>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:46.231341 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-007c012a-8cbc-4da1-94d1-be6f1abecdcb tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/0199b74d-60c5-4027-a319-3ef773987af3" status: 200 len: 287 microversion: 2.1 time: 0.080882 Sep 02 17:08:46.235677 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 11/23] 10.222.0.41 () {58 vars in 1251 bytes} [Thu Sep 2 17:08:46 2021] GET /compute/v2.1/os-snapshots/0199b74d-60c5-4027-a319-3ef773987af3 => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:08:46.299256 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-bf95f808-c160-43f6-bc2e-260ac5139f1d tempest-VolumesGetTestJSON-946075151 tempest-VolumesGetTestJSON-946075151-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/863df15f-1ab3-410d-8f25-a6ab4244d117" status: 200 len: 353 microversion: 2.1 time: 0.153020 Sep 02 17:08:46.300808 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 13/24] 10.222.0.41 () {58 vars in 1245 bytes} [Thu Sep 2 17:08:46 2021] GET /compute/v2.1/os-volumes/863df15f-1ab3-410d-8f25-a6ab4244d117 => generated 353 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:08:46.483878 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-813989af-442a-45b7-a5ca-07e92761e76d tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:46.484945 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-813989af-442a-45b7-a5ca-07e92761e76d tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] [instance: 731fe663-d306-40c9-bc5b-af255b67d8d8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:08:46.501212 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-813989af-442a-45b7-a5ca-07e92761e76d tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:46.503393 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-813989af-442a-45b7-a5ca-07e92761e76d tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:46.512521 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-813989af-442a-45b7-a5ca-07e92761e76d tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:46.513463 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-813989af-442a-45b7-a5ca-07e92761e76d tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:46.715724 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-813989af-442a-45b7-a5ca-07e92761e76d tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0551e3470b724193ade42d712dfcca04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e70c9c6e0d4dc8ad9911fa97233da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:08:46.725918 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-813989af-442a-45b7-a5ca-07e92761e76d tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] 10.222.0.41 "GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8" status: 200 len: 1219 microversion: 2.1 time: 0.256428 Sep 02 17:08:46.727723 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 12/25] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:08:46 2021] GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8 => generated 1219 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:08:46.806422 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-f403906f-6138-473a-a41e-13e3d840079b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:46.807638 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-f403906f-6138-473a-a41e-13e3d840079b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:08:46.814924 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f403906f-6138-473a-a41e-13e3d840079b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:46.815856 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f403906f-6138-473a-a41e-13e3d840079b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:46.817064 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f403906f-6138-473a-a41e-13e3d840079b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:46.817782 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f403906f-6138-473a-a41e-13e3d840079b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:47.246532 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-6df59be6-4888-4fb9-8c39-33836b8fe88c tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] Calling method '.version_select at 0x7fca9912cf70>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:47.317068 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-6df59be6-4888-4fb9-8c39-33836b8fe88c tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/0199b74d-60c5-4027-a319-3ef773987af3" status: 200 len: 288 microversion: 2.1 time: 0.075094 Sep 02 17:08:47.324181 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 13/26] 10.222.0.41 () {58 vars in 1251 bytes} [Thu Sep 2 17:08:47 2021] GET /compute/v2.1/os-snapshots/0199b74d-60c5-4027-a319-3ef773987af3 => generated 288 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:08:47.329220 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-dc7831f8-b4ff-4368-9f08-018d06b3da2a tempest-VolumesGetTestJSON-946075151 tempest-VolumesGetTestJSON-946075151-project] Calling method '.version_select at 0x7fca990b8670>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:47.469938 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-dc7831f8-b4ff-4368-9f08-018d06b3da2a tempest-VolumesGetTestJSON-946075151 tempest-VolumesGetTestJSON-946075151-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/863df15f-1ab3-410d-8f25-a6ab4244d117" status: 200 len: 353 microversion: 2.1 time: 0.144447 Sep 02 17:08:47.470846 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 14/27] 10.222.0.41 () {58 vars in 1245 bytes} [Thu Sep 2 17:08:47 2021] GET /compute/v2.1/os-volumes/863df15f-1ab3-410d-8f25-a6ab4244d117 => generated 353 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:08:47.482527 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-4f373d39-0857-4957-ba7f-0df3842f828c tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] Calling method '.version_select at 0x7fca9905aaf0>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:47.526472 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-f403906f-6138-473a-a41e-13e3d840079b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:08:47.576670 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-f403906f-6138-473a-a41e-13e3d840079b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97" status: 200 len: 1222 microversion: 2.1 time: 0.775041 Sep 02 17:08:47.593295 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 14/28] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:08:46 2021] GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 => generated 1222 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:08:47.670316 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-4f373d39-0857-4957-ba7f-0df3842f828c tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] 10.222.0.41 "DELETE /compute/v2.1/os-snapshots/0199b74d-60c5-4027-a319-3ef773987af3" status: 202 len: 0 microversion: 2.1 time: 0.192278 Sep 02 17:08:47.671161 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 15/29] 10.222.0.41 () {58 vars in 1254 bytes} [Thu Sep 2 17:08:47 2021] DELETE /compute/v2.1/os-snapshots/0199b74d-60c5-4027-a319-3ef773987af3 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:08:47.680826 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-fa6b229d-ee6c-4026-a374-8d7a6b4cd1f6 tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] Calling method '.version_select at 0x7fca9909eee0>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:47.744064 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-6b7b3474-4f61-47f6-9b27-307dcf21d62a tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:47.744996 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-6b7b3474-4f61-47f6-9b27-307dcf21d62a tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] [instance: 731fe663-d306-40c9-bc5b-af255b67d8d8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:08:47.754100 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6b7b3474-4f61-47f6-9b27-307dcf21d62a tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:47.756069 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6b7b3474-4f61-47f6-9b27-307dcf21d62a tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:47.759022 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6b7b3474-4f61-47f6-9b27-307dcf21d62a tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:47.761228 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6b7b3474-4f61-47f6-9b27-307dcf21d62a tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:47.857439 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-fa6b229d-ee6c-4026-a374-8d7a6b4cd1f6 tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/0199b74d-60c5-4027-a319-3ef773987af3" status: 200 len: 287 microversion: 2.1 time: 0.180685 Sep 02 17:08:47.858218 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 15/30] 10.222.0.41 () {58 vars in 1251 bytes} [Thu Sep 2 17:08:47 2021] GET /compute/v2.1/os-snapshots/0199b74d-60c5-4027-a319-3ef773987af3 => generated 287 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:08:47.922898 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-6b7b3474-4f61-47f6-9b27-307dcf21d62a tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0551e3470b724193ade42d712dfcca04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e70c9c6e0d4dc8ad9911fa97233da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:08:47.930951 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-6b7b3474-4f61-47f6-9b27-307dcf21d62a tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] 10.222.0.41 "GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8" status: 200 len: 1211 microversion: 2.1 time: 0.190933 Sep 02 17:08:47.943115 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 16/31] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:08:47 2021] GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8 => generated 1211 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:08:48.484936 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-a8bf6f11-5a79-4e65-a770-2959b93afc40 tempest-VolumesGetTestJSON-946075151 tempest-VolumesGetTestJSON-946075151-project] Calling method '.version_select at 0x7fca990adaf0>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:48.560028 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.wsgi [None req-a8bf6f11-5a79-4e65-a770-2959b93afc40 tempest-VolumesGetTestJSON-946075151 tempest-VolumesGetTestJSON-946075151-project] HTTP exception thrown: Volume 863df15f-1ab3-410d-8f25-a6ab4244d117 could not be found. Sep 02 17:08:48.561382 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-a8bf6f11-5a79-4e65-a770-2959b93afc40 tempest-VolumesGetTestJSON-946075151 tempest-VolumesGetTestJSON-946075151-project] Returning 404 to user: Volume 863df15f-1ab3-410d-8f25-a6ab4244d117 could not be found. {{(pid=108417) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:08:48.567357 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-a8bf6f11-5a79-4e65-a770-2959b93afc40 tempest-VolumesGetTestJSON-946075151 tempest-VolumesGetTestJSON-946075151-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/863df15f-1ab3-410d-8f25-a6ab4244d117" status: 404 len: 109 microversion: 2.1 time: 0.086940 Sep 02 17:08:48.568805 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 16/32] 10.222.0.41 () {58 vars in 1245 bytes} [Thu Sep 2 17:08:48 2021] GET /compute/v2.1/os-volumes/863df15f-1ab3-410d-8f25-a6ab4244d117 => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 17:08:48.604330 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-54826e0a-6db7-411c-85b2-800a96b1213b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:48.606571 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-54826e0a-6db7-411c-85b2-800a96b1213b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:08:48.620527 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-54826e0a-6db7-411c-85b2-800a96b1213b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:48.624610 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-54826e0a-6db7-411c-85b2-800a96b1213b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:48.625845 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-54826e0a-6db7-411c-85b2-800a96b1213b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:48.628965 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-54826e0a-6db7-411c-85b2-800a96b1213b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:48.873752 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-ffe67bda-5c48-4fbf-9f6b-82c39f8eff15 tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] Calling method '.version_select at 0x7fca990ad790>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:48.973009 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.wsgi [None req-ffe67bda-5c48-4fbf-9f6b-82c39f8eff15 tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] HTTP exception thrown: Snapshot 0199b74d-60c5-4027-a319-3ef773987af3 could not be found. Sep 02 17:08:48.974289 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-ffe67bda-5c48-4fbf-9f6b-82c39f8eff15 tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] Returning 404 to user: Snapshot 0199b74d-60c5-4027-a319-3ef773987af3 could not be found. {{(pid=108417) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:08:48.975432 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-ffe67bda-5c48-4fbf-9f6b-82c39f8eff15 tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] 10.222.0.41 "GET /compute/v2.1/os-snapshots/0199b74d-60c5-4027-a319-3ef773987af3" status: 404 len: 111 microversion: 2.1 time: 0.106747 Sep 02 17:08:48.976660 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 17/33] 10.222.0.41 () {58 vars in 1251 bytes} [Thu Sep 2 17:08:48 2021] GET /compute/v2.1/os-snapshots/0199b74d-60c5-4027-a319-3ef773987af3 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 17:08:48.999323 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-ff4e9717-3c54-4961-b4b1-142fb215e15a tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:48.999323 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-ff4e9717-3c54-4961-b4b1-142fb215e15a tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] [instance: 731fe663-d306-40c9-bc5b-af255b67d8d8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:08:49.003682 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ff4e9717-3c54-4961-b4b1-142fb215e15a tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:49.004709 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ff4e9717-3c54-4961-b4b1-142fb215e15a tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:49.007246 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ff4e9717-3c54-4961-b4b1-142fb215e15a tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:49.008048 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ff4e9717-3c54-4961-b4b1-142fb215e15a tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:49.096451 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-54826e0a-6db7-411c-85b2-800a96b1213b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:08:49.206501 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-54826e0a-6db7-411c-85b2-800a96b1213b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97" status: 200 len: 1270 microversion: 2.1 time: 0.511623 Sep 02 17:08:49.206501 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 17/34] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:08:48 2021] GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 => generated 1270 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:08:49.206501 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-783a15ad-8c46-41f1-bdc8-9dfd863e9308 tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] Calling method '.version_select at 0x7fca990b8550>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:49.248567 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-783a15ad-8c46-41f1-bdc8-9dfd863e9308 tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/0796e8f6-384e-4c21-a31a-1a3cb05d0148" status: 202 len: 0 microversion: 2.1 time: 0.118986 Sep 02 17:08:49.250243 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 18/35] 10.222.0.41 () {58 vars in 1248 bytes} [Thu Sep 2 17:08:49 2021] DELETE /compute/v2.1/os-volumes/0796e8f6-384e-4c21-a31a-1a3cb05d0148 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:08:49.258741 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-902c6519-9ed3-412d-807d-035f0b92d0d4 tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] Calling method '.version_select at 0x7fca990b8b80>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:49.410395 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-902c6519-9ed3-412d-807d-035f0b92d0d4 tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/0796e8f6-384e-4c21-a31a-1a3cb05d0148" status: 200 len: 344 microversion: 2.1 time: 0.156506 Sep 02 17:08:49.419513 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 19/36] 10.222.0.41 () {58 vars in 1245 bytes} [Thu Sep 2 17:08:49 2021] GET /compute/v2.1/os-volumes/0796e8f6-384e-4c21-a31a-1a3cb05d0148 => generated 344 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:08:49.428235 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-ff4e9717-3c54-4961-b4b1-142fb215e15a tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0551e3470b724193ade42d712dfcca04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e70c9c6e0d4dc8ad9911fa97233da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:08:49.441475 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-ff4e9717-3c54-4961-b4b1-142fb215e15a tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] 10.222.0.41 "GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8" status: 200 len: 1211 microversion: 2.1 time: 0.463380 Sep 02 17:08:49.461321 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 18/37] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:08:48 2021] GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8 => generated 1211 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:08:50.136182 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-22ee75a5-2dad-4384-814c-ea5df8390edd tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:50.136854 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-22ee75a5-2dad-4384-814c-ea5df8390edd tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:08:50.151897 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-22ee75a5-2dad-4384-814c-ea5df8390edd tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:50.152629 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-22ee75a5-2dad-4384-814c-ea5df8390edd tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:50.154369 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-22ee75a5-2dad-4384-814c-ea5df8390edd tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:50.155023 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-22ee75a5-2dad-4384-814c-ea5df8390edd tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:50.431039 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-66207ec3-f6b7-4351-b570-c31967709155 tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] Calling method '.version_select at 0x7fca990ccd30>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:50.464037 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-22ee75a5-2dad-4384-814c-ea5df8390edd tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:08:50.487612 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-22ee75a5-2dad-4384-814c-ea5df8390edd tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97" status: 200 len: 1276 microversion: 2.1 time: 0.352266 Sep 02 17:08:50.489817 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 20/38] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:08:50 2021] GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 => generated 1276 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:08:50.514230 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.wsgi [None req-66207ec3-f6b7-4351-b570-c31967709155 tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] HTTP exception thrown: Volume 0796e8f6-384e-4c21-a31a-1a3cb05d0148 could not be found. Sep 02 17:08:50.515180 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-66207ec3-f6b7-4351-b570-c31967709155 tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] Returning 404 to user: Volume 0796e8f6-384e-4c21-a31a-1a3cb05d0148 could not be found. {{(pid=108417) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:08:50.516179 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-66207ec3-f6b7-4351-b570-c31967709155 tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/0796e8f6-384e-4c21-a31a-1a3cb05d0148" status: 404 len: 109 microversion: 2.1 time: 0.094214 Sep 02 17:08:50.517058 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 19/39] 10.222.0.41 () {58 vars in 1245 bytes} [Thu Sep 2 17:08:50 2021] GET /compute/v2.1/os-volumes/0796e8f6-384e-4c21-a31a-1a3cb05d0148 => generated 109 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 17:08:50.522999 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-d8e91bee-8b45-464e-8a64-79e5a62bcde9 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:50.527068 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-d8e91bee-8b45-464e-8a64-79e5a62bcde9 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] [instance: 731fe663-d306-40c9-bc5b-af255b67d8d8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:08:50.546559 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d8e91bee-8b45-464e-8a64-79e5a62bcde9 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:50.552982 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d8e91bee-8b45-464e-8a64-79e5a62bcde9 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:50.557221 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d8e91bee-8b45-464e-8a64-79e5a62bcde9 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:50.558876 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d8e91bee-8b45-464e-8a64-79e5a62bcde9 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:50.837177 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-e26e7f9d-bded-46f9-a68a-9f1e61332ca1 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'create', calling method: .version_select at 0x7fca9ac40dc0>, body: {"keypair": {"name": "tempest-keypair-570871693"}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:08:50.907895 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-d8e91bee-8b45-464e-8a64-79e5a62bcde9 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0551e3470b724193ade42d712dfcca04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e70c9c6e0d4dc8ad9911fa97233da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:08:50.914142 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.quota [None req-e26e7f9d-bded-46f9-a68a-9f1e61332ca1 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Getting quotas for project 70d941aa2c0e4b9eac9950e6e8237615. Resources: {'key_pairs'} {{(pid=108418) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 17:08:50.937950 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.quota [None req-e26e7f9d-bded-46f9-a68a-9f1e61332ca1 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Getting quotas for user d11ab044b0ba41be87b038204b161d8f and project 70d941aa2c0e4b9eac9950e6e8237615. Resources: {'key_pairs'} {{(pid=108418) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 17:08:50.945068 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-d8e91bee-8b45-464e-8a64-79e5a62bcde9 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] 10.222.0.41 "GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8" status: 200 len: 1273 microversion: 2.1 time: 0.423684 Sep 02 17:08:50.958652 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 20/40] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:08:50 2021] GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8 => generated 1273 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:08:50.987531 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-ead76f2a-3573-4ee9-8676-b1d77bd8e1a0 tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] Calling method '.version_select at 0x7fca990ad940>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:51.056413 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.wsgi [None req-ead76f2a-3573-4ee9-8676-b1d77bd8e1a0 tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] HTTP exception thrown: Volume 0796e8f6-384e-4c21-a31a-1a3cb05d0148 could not be found. Sep 02 17:08:51.058553 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-ead76f2a-3573-4ee9-8676-b1d77bd8e1a0 tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] Returning 404 to user: Volume 0796e8f6-384e-4c21-a31a-1a3cb05d0148 could not be found. {{(pid=108417) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:08:51.060281 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-ead76f2a-3573-4ee9-8676-b1d77bd8e1a0 tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/0796e8f6-384e-4c21-a31a-1a3cb05d0148" status: 404 len: 109 microversion: 2.1 time: 0.095116 Sep 02 17:08:51.061018 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 21/41] 10.222.0.41 () {58 vars in 1248 bytes} [Thu Sep 2 17:08:50 2021] DELETE /compute/v2.1/os-volumes/0796e8f6-384e-4c21-a31a-1a3cb05d0148 => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 17:08:51.074279 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-afef1d8e-63f2-452a-a620-bab7412432df tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] Calling method '.version_select at 0x7fca990810d0>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:51.158290 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.wsgi [None req-afef1d8e-63f2-452a-a620-bab7412432df tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] HTTP exception thrown: Volume 0796e8f6-384e-4c21-a31a-1a3cb05d0148 could not be found. Sep 02 17:08:51.159582 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-afef1d8e-63f2-452a-a620-bab7412432df tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] Returning 404 to user: Volume 0796e8f6-384e-4c21-a31a-1a3cb05d0148 could not be found. {{(pid=108417) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:08:51.161871 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-afef1d8e-63f2-452a-a620-bab7412432df tempest-VolumesSnapshotsTestJSON-1898252010 tempest-VolumesSnapshotsTestJSON-1898252010-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/0796e8f6-384e-4c21-a31a-1a3cb05d0148" status: 404 len: 109 microversion: 2.1 time: 0.092845 Sep 02 17:08:51.163501 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 22/42] 10.222.0.41 () {58 vars in 1245 bytes} [Thu Sep 2 17:08:51 2021] GET /compute/v2.1/os-volumes/0796e8f6-384e-4c21-a31a-1a3cb05d0148 => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 17:08:51.470269 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.quota [None req-e26e7f9d-bded-46f9-a68a-9f1e61332ca1 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Getting quotas for project 70d941aa2c0e4b9eac9950e6e8237615. Resources: {'key_pairs'} {{(pid=108418) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 17:08:51.497308 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.quota [None req-e26e7f9d-bded-46f9-a68a-9f1e61332ca1 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Getting quotas for user d11ab044b0ba41be87b038204b161d8f and project 70d941aa2c0e4b9eac9950e6e8237615. Resources: {'key_pairs'} {{(pid=108418) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 17:08:51.507899 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-da6472ed-1fe3-4e1a-9d26-18a53f008cb8 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:51.508476 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-da6472ed-1fe3-4e1a-9d26-18a53f008cb8 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:08:51.527502 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-da6472ed-1fe3-4e1a-9d26-18a53f008cb8 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:51.527953 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-da6472ed-1fe3-4e1a-9d26-18a53f008cb8 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:51.542185 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-da6472ed-1fe3-4e1a-9d26-18a53f008cb8 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:51.546830 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-da6472ed-1fe3-4e1a-9d26-18a53f008cb8 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:51.560621 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-e26e7f9d-bded-46f9-a68a-9f1e61332ca1 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 1.067914 Sep 02 17:08:51.562341 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 21/43] 10.222.0.41 () {62 vars in 1199 bytes} [Thu Sep 2 17:08:50 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 1072 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Sep 02 17:08:51.965285 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-c04027e6-5950-4135-a224-9e650593e3dd tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:51.966280 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-c04027e6-5950-4135-a224-9e650593e3dd tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] [instance: 731fe663-d306-40c9-bc5b-af255b67d8d8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:08:51.984603 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c04027e6-5950-4135-a224-9e650593e3dd tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:51.995118 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c04027e6-5950-4135-a224-9e650593e3dd tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:51.997261 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c04027e6-5950-4135-a224-9e650593e3dd tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:51.997836 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c04027e6-5950-4135-a224-9e650593e3dd tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:52.325240 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-c04027e6-5950-4135-a224-9e650593e3dd tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0551e3470b724193ade42d712dfcca04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e70c9c6e0d4dc8ad9911fa97233da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:08:52.338292 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-c04027e6-5950-4135-a224-9e650593e3dd tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] 10.222.0.41 "GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8" status: 200 len: 1273 microversion: 2.1 time: 0.376752 Sep 02 17:08:52.340333 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 22/44] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:08:51 2021] GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8 => generated 1273 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:08:52.504666 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-da6472ed-1fe3-4e1a-9d26-18a53f008cb8 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:08:52.529517 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-da6472ed-1fe3-4e1a-9d26-18a53f008cb8 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97" status: 200 len: 1276 microversion: 2.1 time: 1.024202 Sep 02 17:08:52.531568 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 23/45] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:08:51 2021] GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 => generated 1276 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:08:53.355536 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-39671f05-591d-4e9f-b351-89836c61751b tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:53.356159 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-39671f05-591d-4e9f-b351-89836c61751b tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] [instance: 731fe663-d306-40c9-bc5b-af255b67d8d8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:08:53.376596 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-39671f05-591d-4e9f-b351-89836c61751b tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:53.379331 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-39671f05-591d-4e9f-b351-89836c61751b tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:53.381061 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-39671f05-591d-4e9f-b351-89836c61751b tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:53.383332 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-39671f05-591d-4e9f-b351-89836c61751b tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:53.864192 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-ad849d4a-10e2-4932-b1a7-dfc6aa6291e0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'create', calling method: .version_select at 0x7fca990ad4c0>, body: {"keypair": {"name": "tempest-keypair-2038002381"}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:08:54.031122 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.quota [None req-ad849d4a-10e2-4932-b1a7-dfc6aa6291e0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Getting quotas for project efb6337b5a3548bcad9fd236c619842d. Resources: {'key_pairs'} {{(pid=108417) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 17:08:54.056474 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.quota [None req-ad849d4a-10e2-4932-b1a7-dfc6aa6291e0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Getting quotas for user f9a77763fb724542a66e1d5f79f630f5 and project efb6337b5a3548bcad9fd236c619842d. Resources: {'key_pairs'} {{(pid=108417) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 17:08:54.228422 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-39671f05-591d-4e9f-b351-89836c61751b tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0551e3470b724193ade42d712dfcca04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e70c9c6e0d4dc8ad9911fa97233da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:08:54.258843 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-39671f05-591d-4e9f-b351-89836c61751b tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] 10.222.0.41 "GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8" status: 200 len: 1315 microversion: 2.1 time: 0.898971 Sep 02 17:08:54.261893 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 23/46] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:08:53 2021] GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8 => generated 1315 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:08:54.287965 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-af0fdf0b-0f35-499a-8e41-15e9eed7a185 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:54.303767 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-af0fdf0b-0f35-499a-8e41-15e9eed7a185 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:08:54.333320 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-af0fdf0b-0f35-499a-8e41-15e9eed7a185 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:54.334503 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-af0fdf0b-0f35-499a-8e41-15e9eed7a185 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:54.349916 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-af0fdf0b-0f35-499a-8e41-15e9eed7a185 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:54.350376 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-af0fdf0b-0f35-499a-8e41-15e9eed7a185 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:54.702714 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.quota [None req-ad849d4a-10e2-4932-b1a7-dfc6aa6291e0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Getting quotas for project efb6337b5a3548bcad9fd236c619842d. Resources: {'key_pairs'} {{(pid=108417) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 17:08:54.729029 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.quota [None req-ad849d4a-10e2-4932-b1a7-dfc6aa6291e0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Getting quotas for user f9a77763fb724542a66e1d5f79f630f5 and project efb6337b5a3548bcad9fd236c619842d. Resources: {'key_pairs'} {{(pid=108417) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 17:08:54.826264 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-ad849d4a-10e2-4932-b1a7-dfc6aa6291e0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 1.285195 Sep 02 17:08:54.835667 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 24/47] 10.222.0.41 () {60 vars in 1158 bytes} [Thu Sep 2 17:08:53 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:08:55.066163 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-af0fdf0b-0f35-499a-8e41-15e9eed7a185 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:08:55.079563 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-af0fdf0b-0f35-499a-8e41-15e9eed7a185 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97" status: 200 len: 1318 microversion: 2.1 time: 0.815870 Sep 02 17:08:55.088052 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 24/48] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:08:54 2021] GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 => generated 1318 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:08:55.295568 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-9c179743-53b1-435a-9336-edea409f8460 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:55.296309 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-9c179743-53b1-435a-9336-edea409f8460 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] [instance: 731fe663-d306-40c9-bc5b-af255b67d8d8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:08:55.310467 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9c179743-53b1-435a-9336-edea409f8460 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:55.311126 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9c179743-53b1-435a-9336-edea409f8460 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:55.314795 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9c179743-53b1-435a-9336-edea409f8460 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:55.316993 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9c179743-53b1-435a-9336-edea409f8460 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:55.767336 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-7ecde6c0-6e33-4995-ad82-b00801870413 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1389901402", "imageRef": "22ce6e29-f3a7-49f0-b93a-ddbffa14e44e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e89eb299-93b9-401c-ad14-f4bccef9cd1c"}]}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:08:55.949392 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.network.neutron [None req-7ecde6c0-6e33-4995-ad82-b00801870413 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] validate_networks() for [('e89eb299-93b9-401c-ad14-f4bccef9cd1c', None, None, None, None, None)] {{(pid=108417) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 17:08:55.963459 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-9c179743-53b1-435a-9336-edea409f8460 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0551e3470b724193ade42d712dfcca04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e70c9c6e0d4dc8ad9911fa97233da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:08:55.976790 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-9c179743-53b1-435a-9336-edea409f8460 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] 10.222.0.41 "GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8" status: 200 len: 1315 microversion: 2.1 time: 0.689972 Sep 02 17:08:55.980355 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 25/49] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:08:55 2021] GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8 => generated 1315 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:08:56.116204 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-a1cb0dcd-c322-40f7-bf01-487f7c87895d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:56.117030 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-a1cb0dcd-c322-40f7-bf01-487f7c87895d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:08:56.132023 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a1cb0dcd-c322-40f7-bf01-487f7c87895d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:56.132628 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a1cb0dcd-c322-40f7-bf01-487f7c87895d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:56.137245 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a1cb0dcd-c322-40f7-bf01-487f7c87895d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:56.139722 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a1cb0dcd-c322-40f7-bf01-487f7c87895d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:57.117810 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-a1cb0dcd-c322-40f7-bf01-487f7c87895d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:08:57.126166 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-a1cb0dcd-c322-40f7-bf01-487f7c87895d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97" status: 200 len: 1318 microversion: 2.1 time: 1.014879 Sep 02 17:08:57.126766 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 26/50] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:08:56 2021] GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 => generated 1318 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:08:57.143920 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-53d61be0-1eeb-4101-86f1-721feb9cf980 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:57.144542 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-53d61be0-1eeb-4101-86f1-721feb9cf980 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] [instance: 731fe663-d306-40c9-bc5b-af255b67d8d8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:08:57.176749 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-53d61be0-1eeb-4101-86f1-721feb9cf980 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:57.182191 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-53d61be0-1eeb-4101-86f1-721feb9cf980 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:57.184232 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-53d61be0-1eeb-4101-86f1-721feb9cf980 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:57.213560 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-53d61be0-1eeb-4101-86f1-721feb9cf980 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:58.105391 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-53d61be0-1eeb-4101-86f1-721feb9cf980 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0551e3470b724193ade42d712dfcca04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e70c9c6e0d4dc8ad9911fa97233da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:08:58.117889 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-53d61be0-1eeb-4101-86f1-721feb9cf980 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] 10.222.0.41 "GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8" status: 200 len: 1315 microversion: 2.1 time: 0.990026 Sep 02 17:08:58.127551 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 27/51] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:08:57 2021] GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8 => generated 1315 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:08:58.146197 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-b065f214-76cc-4340-8c66-1fdb80babb8e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:58.155586 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-b065f214-76cc-4340-8c66-1fdb80babb8e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:08:58.181055 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b065f214-76cc-4340-8c66-1fdb80babb8e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:58.191406 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b065f214-76cc-4340-8c66-1fdb80babb8e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:58.198266 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b065f214-76cc-4340-8c66-1fdb80babb8e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:58.203292 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b065f214-76cc-4340-8c66-1fdb80babb8e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:59.091385 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-7ecde6c0-6e33-4995-ad82-b00801870413 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Flavor limits 0:0:0 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 17:08:59.091818 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-7ecde6c0-6e33-4995-ad82-b00801870413 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Image limits 0:0:0 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 17:08:59.092274 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-7ecde6c0-6e33-4995-ad82-b00801870413 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Flavor pref 0:0:0 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 17:08:59.092952 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-7ecde6c0-6e33-4995-ad82-b00801870413 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Image pref 0:0:0 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 17:08:59.093374 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-7ecde6c0-6e33-4995-ad82-b00801870413 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 17:08:59.108442 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7ecde6c0-6e33-4995-ad82-b00801870413 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:59.108884 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7ecde6c0-6e33-4995-ad82-b00801870413 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:59.110022 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7ecde6c0-6e33-4995-ad82-b00801870413 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:59.110462 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7ecde6c0-6e33-4995-ad82-b00801870413 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:59.291872 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.quota [None req-7ecde6c0-6e33-4995-ad82-b00801870413 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Getting quotas for project 4d00b04201ec4d46956d03ebddbef781. Resources: {'instances', 'cores', 'ram'} {{(pid=108417) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 17:08:59.328910 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.quota [None req-7ecde6c0-6e33-4995-ad82-b00801870413 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Getting quotas for user 8f0f507b360843a7a853478c0cf360fc and project 4d00b04201ec4d46956d03ebddbef781. Resources: {'instances', 'cores', 'ram'} {{(pid=108417) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 17:08:59.399391 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-7ecde6c0-6e33-4995-ad82-b00801870413 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Going to run 1 instances... {{(pid=108417) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 17:08:59.405301 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-7ecde6c0-6e33-4995-ad82-b00801870413 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22ce6e29-f3a7-49f0-b93a-ddbffa14e44e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108417) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 17:08:59.619977 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-7ecde6c0-6e33-4995-ad82-b00801870413 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.778213 Sep 02 17:08:59.624406 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 25/52] 10.222.0.41 () {60 vars in 1147 bytes} [Thu Sep 2 17:08:54 2021] POST /compute/v2.1/servers => generated 383 bytes in 4788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 17:08:59.660517 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-30a0d003-1429-4842-921c-a327eb68a3b5 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:08:59.663842 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-30a0d003-1429-4842-921c-a327eb68a3b5 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] [instance: 731fe663-d306-40c9-bc5b-af255b67d8d8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:08:59.683602 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-30a0d003-1429-4842-921c-a327eb68a3b5 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:59.687714 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-30a0d003-1429-4842-921c-a327eb68a3b5 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:08:59.688720 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-30a0d003-1429-4842-921c-a327eb68a3b5 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:08:59.692884 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-30a0d003-1429-4842-921c-a327eb68a3b5 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:00.932835 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-b065f214-76cc-4340-8c66-1fdb80babb8e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:00.941636 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-b065f214-76cc-4340-8c66-1fdb80babb8e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97" status: 200 len: 1318 microversion: 2.1 time: 2.799937 Sep 02 17:09:00.944516 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 28/53] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:08:58 2021] GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 => generated 1318 bytes in 2804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:00.953138 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-00242e34-cad2-42f1-a627-c8cd3cef28ab tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:00.991784 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-00242e34-cad2-42f1-a627-c8cd3cef28ab tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:00.992357 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-30a0d003-1429-4842-921c-a327eb68a3b5 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0551e3470b724193ade42d712dfcca04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e70c9c6e0d4dc8ad9911fa97233da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:01.000291 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-30a0d003-1429-4842-921c-a327eb68a3b5 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] 10.222.0.41 "GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8" status: 200 len: 1315 microversion: 2.1 time: 1.371799 Sep 02 17:09:01.000961 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 26/54] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:08:59 2021] GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8 => generated 1315 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:01.253274 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-851da4bb-7089-427d-81ab-bef3c5ee22ac tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-953515834", "imageRef": "22ce6e29-f3a7-49f0-b93a-ddbffa14e44e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "94c8cbb5-40fd-4da4-849b-703835a0088e"}], "security_groups": [{"name": "tempest-securitygroup--729907262"}], "key_name": "tempest-keypair-570871693", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:01.667114 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-00242e34-cad2-42f1-a627-c8cd3cef28ab tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:01.726542 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-00242e34-cad2-42f1-a627-c8cd3cef28ab tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1222 microversion: 2.1 time: 0.776715 Sep 02 17:09:01.780638 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 29/55] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:00 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1222 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:01.970028 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-c37381cb-10f7-4284-9747-a5b151eb5333 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:01.971642 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-c37381cb-10f7-4284-9747-a5b151eb5333 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:01.974760 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.network.neutron [None req-851da4bb-7089-427d-81ab-bef3c5ee22ac tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] validate_networks() for [('94c8cbb5-40fd-4da4-849b-703835a0088e', None, None, None, None, None)] {{(pid=108417) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 17:09:02.017779 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c37381cb-10f7-4284-9747-a5b151eb5333 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:02.018235 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c37381cb-10f7-4284-9747-a5b151eb5333 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:02.028071 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c37381cb-10f7-4284-9747-a5b151eb5333 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:02.029317 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c37381cb-10f7-4284-9747-a5b151eb5333 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:02.968551 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-c37381cb-10f7-4284-9747-a5b151eb5333 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:03.002114 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-c37381cb-10f7-4284-9747-a5b151eb5333 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97" status: 200 len: 1318 microversion: 2.1 time: 1.034119 Sep 02 17:09:03.014866 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 30/56] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:01 2021] GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 => generated 1318 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:03.050903 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-00a07a0a-b041-44d7-96ad-318f39aca06b tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:03.052592 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-00a07a0a-b041-44d7-96ad-318f39aca06b tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] [instance: 731fe663-d306-40c9-bc5b-af255b67d8d8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:03.096382 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-00a07a0a-b041-44d7-96ad-318f39aca06b tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:03.100774 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-00a07a0a-b041-44d7-96ad-318f39aca06b tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:03.107319 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-00a07a0a-b041-44d7-96ad-318f39aca06b tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:03.115324 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-00a07a0a-b041-44d7-96ad-318f39aca06b tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:04.487713 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-851da4bb-7089-427d-81ab-bef3c5ee22ac tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Flavor limits 0:0:0 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 17:09:04.488582 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-851da4bb-7089-427d-81ab-bef3c5ee22ac tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Image limits 0:0:0 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 17:09:04.489588 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-851da4bb-7089-427d-81ab-bef3c5ee22ac tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Flavor pref 0:0:0 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 17:09:04.490555 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-851da4bb-7089-427d-81ab-bef3c5ee22ac tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Image pref 0:0:0 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 17:09:04.491314 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-851da4bb-7089-427d-81ab-bef3c5ee22ac tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 17:09:04.522047 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-00a07a0a-b041-44d7-96ad-318f39aca06b tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0551e3470b724193ade42d712dfcca04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e70c9c6e0d4dc8ad9911fa97233da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:04.523616 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-851da4bb-7089-427d-81ab-bef3c5ee22ac tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:04.527163 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-851da4bb-7089-427d-81ab-bef3c5ee22ac tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:04.529540 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-851da4bb-7089-427d-81ab-bef3c5ee22ac tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:04.532408 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-851da4bb-7089-427d-81ab-bef3c5ee22ac tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:04.551366 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-00a07a0a-b041-44d7-96ad-318f39aca06b tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] 10.222.0.41 "GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8" status: 200 len: 1315 microversion: 2.1 time: 1.544320 Sep 02 17:09:04.551859 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 31/57] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:03 2021] GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8 => generated 1315 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:04.585094 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-5872a4df-862c-4a8e-8123-c1f8b7156cf3 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2102985641", "imageRef": "22ce6e29-f3a7-49f0-b93a-ddbffa14e44e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e89eb299-93b9-401c-ad14-f4bccef9cd1c"}]}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:04.607791 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.quota [None req-851da4bb-7089-427d-81ab-bef3c5ee22ac tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Getting quotas for project 70d941aa2c0e4b9eac9950e6e8237615. Resources: {'instances', 'cores', 'ram'} {{(pid=108417) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 17:09:04.670716 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.quota [None req-851da4bb-7089-427d-81ab-bef3c5ee22ac tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Getting quotas for user d11ab044b0ba41be87b038204b161d8f and project 70d941aa2c0e4b9eac9950e6e8237615. Resources: {'instances', 'cores', 'ram'} {{(pid=108417) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 17:09:04.724623 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-851da4bb-7089-427d-81ab-bef3c5ee22ac tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Going to run 1 instances... {{(pid=108417) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 17:09:04.732429 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-851da4bb-7089-427d-81ab-bef3c5ee22ac tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22ce6e29-f3a7-49f0-b93a-ddbffa14e44e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108417) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 17:09:04.772636 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.network.neutron [None req-5872a4df-862c-4a8e-8123-c1f8b7156cf3 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] validate_networks() for [('e89eb299-93b9-401c-ad14-f4bccef9cd1c', None, None, None, None, None)] {{(pid=108418) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 17:09:04.826362 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-851da4bb-7089-427d-81ab-bef3c5ee22ac tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.577194 Sep 02 17:09:04.836618 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 27/58] 10.222.0.41 () {62 vars in 1188 bytes} [Thu Sep 2 17:09:01 2021] POST /compute/v2.1/servers => generated 401 bytes in 3587 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 02 17:09:04.856035 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-a0116c65-e54b-41aa-8cb1-a7a4428b93c5 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:04.858516 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-a0116c65-e54b-41aa-8cb1-a7a4428b93c5 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:04.877748 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a0116c65-e54b-41aa-8cb1-a7a4428b93c5 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:04.878388 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a0116c65-e54b-41aa-8cb1-a7a4428b93c5 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:04.880967 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a0116c65-e54b-41aa-8cb1-a7a4428b93c5 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:04.882295 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a0116c65-e54b-41aa-8cb1-a7a4428b93c5 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:05.947731 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-a0116c65-e54b-41aa-8cb1-a7a4428b93c5 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:05.955665 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-a0116c65-e54b-41aa-8cb1-a7a4428b93c5 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97" status: 200 len: 1318 microversion: 2.1 time: 1.117270 Sep 02 17:09:05.956238 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 28/59] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:04 2021] GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 => generated 1318 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:06.243748 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [req-a01dc035-9e72-4dff-a2e9-3906560798ea req-aaabef6b-2692-43a5-bd5a-6ed015c03154 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc38d921-f6d4-4f6c-89c1-08e1c2d96c97", "tag": "7e2fc8cd-4943-4413-bed6-883f6ed096b2"}]} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:06.246820 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:09:06.246820 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: warnings.warn(msg) Sep 02 17:09:06.260225 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-a01dc035-9e72-4dff-a2e9-3906560798ea req-aaabef6b-2692-43a5-bd5a-6ed015c03154 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:06.260890 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-a01dc035-9e72-4dff-a2e9-3906560798ea req-aaabef6b-2692-43a5-bd5a-6ed015c03154 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:06.284130 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.compute.server_external_events [req-a01dc035-9e72-4dff-a2e9-3906560798ea req-aaabef6b-2692-43a5-bd5a-6ed015c03154 service nova] Creating event network-changed:7e2fc8cd-4943-4413-bed6-883f6ed096b2 for instance fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 on hv-cinder-80626 Sep 02 17:09:06.284647 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-a01dc035-9e72-4dff-a2e9-3906560798ea req-aaabef6b-2692-43a5-bd5a-6ed015c03154 service nova] Acquired lock "compute-rpcapi-router" {{(pid=108417) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Sep 02 17:09:06.285772 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a79ba9fa-5ddb-4046-b280-287de5463875 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:06.286240 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a79ba9fa-5ddb-4046-b280-287de5463875 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:06.287063 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a79ba9fa-5ddb-4046-b280-287de5463875 None None] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:06.287496 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a79ba9fa-5ddb-4046-b280-287de5463875 None None] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:06.297265 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.compute.rpcapi [None req-a79ba9fa-5ddb-4046-b280-287de5463875 None None] Automatically selected compute RPC version 6.0 from minimum service version 59 Sep 02 17:09:06.298299 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a79ba9fa-5ddb-4046-b280-287de5463875 None None] Releasing lock "compute-rpcapi-router" {{(pid=108417) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Sep 02 17:09:06.328983 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-a79ba9fa-5ddb-4046-b280-287de5463875 None None] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.371431 Sep 02 17:09:06.329945 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 29/60] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:09:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:09:06.339176 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-ef955ab2-3bea-4d51-9f36-c7b49fbd33cb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1122348869", "imageRef": "22ce6e29-f3a7-49f0-b93a-ddbffa14e44e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cb42942f-ef9a-49eb-b2f9-e00e0bd8f527"}], "security_groups": [{"name": "tempest-securitygroup--264376516"}], "key_name": "tempest-keypair-2038002381", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:06.493469 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.network.neutron [None req-ef955ab2-3bea-4d51-9f36-c7b49fbd33cb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] validate_networks() for [('cb42942f-ef9a-49eb-b2f9-e00e0bd8f527', None, None, None, None, None)] {{(pid=108417) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 17:09:06.640520 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-5872a4df-862c-4a8e-8123-c1f8b7156cf3 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Flavor limits 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 17:09:06.641861 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-5872a4df-862c-4a8e-8123-c1f8b7156cf3 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Image limits 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 17:09:06.642493 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-5872a4df-862c-4a8e-8123-c1f8b7156cf3 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Flavor pref 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 17:09:06.642938 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-5872a4df-862c-4a8e-8123-c1f8b7156cf3 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Image pref 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 17:09:06.643574 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-5872a4df-862c-4a8e-8123-c1f8b7156cf3 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 17:09:06.657743 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5872a4df-862c-4a8e-8123-c1f8b7156cf3 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:06.658792 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5872a4df-862c-4a8e-8123-c1f8b7156cf3 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:06.659857 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5872a4df-862c-4a8e-8123-c1f8b7156cf3 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:06.660863 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5872a4df-862c-4a8e-8123-c1f8b7156cf3 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:06.703096 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.quota [None req-5872a4df-862c-4a8e-8123-c1f8b7156cf3 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Getting quotas for project 4d00b04201ec4d46956d03ebddbef781. Resources: {'instances', 'cores', 'ram'} {{(pid=108418) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 17:09:06.708475 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.quota [None req-5872a4df-862c-4a8e-8123-c1f8b7156cf3 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Getting quotas for user 8f0f507b360843a7a853478c0cf360fc and project 4d00b04201ec4d46956d03ebddbef781. Resources: {'instances', 'cores', 'ram'} {{(pid=108418) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 17:09:06.741753 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-5872a4df-862c-4a8e-8123-c1f8b7156cf3 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Going to run 1 instances... {{(pid=108418) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 17:09:06.744505 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-5872a4df-862c-4a8e-8123-c1f8b7156cf3 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22ce6e29-f3a7-49f0-b93a-ddbffa14e44e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108418) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 17:09:06.897421 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-5872a4df-862c-4a8e-8123-c1f8b7156cf3 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.344429 Sep 02 17:09:06.899129 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 32/61] 10.222.0.41 () {60 vars in 1147 bytes} [Thu Sep 2 17:09:04 2021] POST /compute/v2.1/servers => generated 383 bytes in 2347 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 17:09:07.412438 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-3975e770-fa23-405d-b8e7-3c95a54567b3 req-d5a9b184-7f6b-4d3d-a337-138d9054ec31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "731fe663-d306-40c9-bc5b-af255b67d8d8", "tag": "84985843-a05d-4eec-a8e6-63d146fd1bf1"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:07.416096 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:09:07.416096 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:09:07.440679 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-3975e770-fa23-405d-b8e7-3c95a54567b3 req-d5a9b184-7f6b-4d3d-a337-138d9054ec31 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:07.441575 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-3975e770-fa23-405d-b8e7-3c95a54567b3 req-d5a9b184-7f6b-4d3d-a337-138d9054ec31 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:07.482138 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-3975e770-fa23-405d-b8e7-3c95a54567b3 req-d5a9b184-7f6b-4d3d-a337-138d9054ec31 service nova] Creating event network-changed:84985843-a05d-4eec-a8e6-63d146fd1bf1 for instance 731fe663-d306-40c9-bc5b-af255b67d8d8 on hv-cinder-80626 Sep 02 17:09:07.487998 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-3975e770-fa23-405d-b8e7-3c95a54567b3 req-d5a9b184-7f6b-4d3d-a337-138d9054ec31 service nova] Acquired lock "compute-rpcapi-router" {{(pid=108418) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Sep 02 17:09:07.489689 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c7681b01-ccc2-4f3a-b36b-b2381a5bfd12 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:07.490380 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c7681b01-ccc2-4f3a-b36b-b2381a5bfd12 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:07.493174 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c7681b01-ccc2-4f3a-b36b-b2381a5bfd12 None None] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:07.493736 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c7681b01-ccc2-4f3a-b36b-b2381a5bfd12 None None] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:07.515965 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.compute.rpcapi [None req-c7681b01-ccc2-4f3a-b36b-b2381a5bfd12 None None] Automatically selected compute RPC version 6.0 from minimum service version 59 Sep 02 17:09:07.519206 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c7681b01-ccc2-4f3a-b36b-b2381a5bfd12 None None] Releasing lock "compute-rpcapi-router" {{(pid=108418) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Sep 02 17:09:07.578597 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-c7681b01-ccc2-4f3a-b36b-b2381a5bfd12 None None] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.676532 Sep 02 17:09:07.579692 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 33/62] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:09:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:09:07.585074 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-ffd54222-5311-4d41-8c60-7507bfe8dec9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:07.585970 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-ffd54222-5311-4d41-8c60-7507bfe8dec9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:07.602596 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ffd54222-5311-4d41-8c60-7507bfe8dec9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:07.603535 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ffd54222-5311-4d41-8c60-7507bfe8dec9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:07.605000 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ffd54222-5311-4d41-8c60-7507bfe8dec9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:07.607800 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ffd54222-5311-4d41-8c60-7507bfe8dec9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:08.073442 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-ef955ab2-3bea-4d51-9f36-c7b49fbd33cb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Flavor limits 0:0:0 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 17:09:08.073937 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-ef955ab2-3bea-4d51-9f36-c7b49fbd33cb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Image limits 0:0:0 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 17:09:08.074336 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-ef955ab2-3bea-4d51-9f36-c7b49fbd33cb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Flavor pref 0:0:0 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 17:09:08.075118 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-ef955ab2-3bea-4d51-9f36-c7b49fbd33cb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Image pref 0:0:0 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 17:09:08.075668 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-ef955ab2-3bea-4d51-9f36-c7b49fbd33cb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 17:09:08.080689 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-ffd54222-5311-4d41-8c60-7507bfe8dec9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:08.097955 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ef955ab2-3bea-4d51-9f36-c7b49fbd33cb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:08.098608 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-ffd54222-5311-4d41-8c60-7507bfe8dec9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:08.101522 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ef955ab2-3bea-4d51-9f36-c7b49fbd33cb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:08.104131 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-ffd54222-5311-4d41-8c60-7507bfe8dec9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:08.105108 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ef955ab2-3bea-4d51-9f36-c7b49fbd33cb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:08.105599 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ef955ab2-3bea-4d51-9f36-c7b49fbd33cb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:08.107120 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-ffd54222-5311-4d41-8c60-7507bfe8dec9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1332 microversion: 2.20 time: 0.525465 Sep 02 17:09:08.110368 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 34/63] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:09:07 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1332 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:09:08.123898 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-966a56dd-64d4-440f-9cb7-39fc55e6737a tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:08.125920 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-966a56dd-64d4-440f-9cb7-39fc55e6737a tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] [instance: 731fe663-d306-40c9-bc5b-af255b67d8d8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:08.145995 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-966a56dd-64d4-440f-9cb7-39fc55e6737a tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:08.147167 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-966a56dd-64d4-440f-9cb7-39fc55e6737a tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:08.149936 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-966a56dd-64d4-440f-9cb7-39fc55e6737a tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:08.150744 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-966a56dd-64d4-440f-9cb7-39fc55e6737a tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:08.163103 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.quota [None req-ef955ab2-3bea-4d51-9f36-c7b49fbd33cb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Getting quotas for project efb6337b5a3548bcad9fd236c619842d. Resources: {'instances', 'cores', 'ram'} {{(pid=108417) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 17:09:08.177159 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.quota [None req-ef955ab2-3bea-4d51-9f36-c7b49fbd33cb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Getting quotas for user f9a77763fb724542a66e1d5f79f630f5 and project efb6337b5a3548bcad9fd236c619842d. Resources: {'instances', 'cores', 'ram'} {{(pid=108417) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 17:09:08.210940 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-ef955ab2-3bea-4d51-9f36-c7b49fbd33cb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Going to run 1 instances... {{(pid=108417) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 17:09:08.213246 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-ef955ab2-3bea-4d51-9f36-c7b49fbd33cb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22ce6e29-f3a7-49f0-b93a-ddbffa14e44e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108417) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 17:09:08.277429 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-ef955ab2-3bea-4d51-9f36-c7b49fbd33cb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.945555 Sep 02 17:09:08.278680 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 30/64] 10.222.0.41 () {60 vars in 1147 bytes} [Thu Sep 2 17:09:06 2021] POST /compute/v2.1/servers => generated 401 bytes in 1948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 17:09:08.283786 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-dff4b28a-a1ac-4e40-90f1-86818aef1876 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:08.284595 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-dff4b28a-a1ac-4e40-90f1-86818aef1876 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:08.291156 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-dff4b28a-a1ac-4e40-90f1-86818aef1876 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:08.291846 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-dff4b28a-a1ac-4e40-90f1-86818aef1876 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:08.292793 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-dff4b28a-a1ac-4e40-90f1-86818aef1876 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:08.293383 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-dff4b28a-a1ac-4e40-90f1-86818aef1876 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:08.382729 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-dff4b28a-a1ac-4e40-90f1-86818aef1876 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:08.390896 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-dff4b28a-a1ac-4e40-90f1-86818aef1876 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1274 microversion: 2.1 time: 0.110707 Sep 02 17:09:08.392113 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 31/65] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:08 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1274 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:08.397172 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-b12ae9be-2ffd-4a18-b1d5-bc4828aafb45 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:08.399445 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-b12ae9be-2ffd-4a18-b1d5-bc4828aafb45 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:08.406583 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b12ae9be-2ffd-4a18-b1d5-bc4828aafb45 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:08.407082 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b12ae9be-2ffd-4a18-b1d5-bc4828aafb45 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:08.407860 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b12ae9be-2ffd-4a18-b1d5-bc4828aafb45 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:08.408293 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b12ae9be-2ffd-4a18-b1d5-bc4828aafb45 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:08.718364 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-b12ae9be-2ffd-4a18-b1d5-bc4828aafb45 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:08.726520 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-b12ae9be-2ffd-4a18-b1d5-bc4828aafb45 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97" status: 200 len: 1318 microversion: 2.1 time: 0.333066 Sep 02 17:09:08.727610 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 32/66] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:08 2021] GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 => generated 1318 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:08.734071 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-65c4d9e2-3ea9-45ff-9178-65ced7fffa91 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:08.736764 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-65c4d9e2-3ea9-45ff-9178-65ced7fffa91 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:08.818323 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-65c4d9e2-3ea9-45ff-9178-65ced7fffa91 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:08.832726 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-65c4d9e2-3ea9-45ff-9178-65ced7fffa91 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1238 microversion: 2.1 time: 0.103211 Sep 02 17:09:08.833984 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 33/67] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:08 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1238 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:09.138665 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-aa26b9b0-1cb7-4db2-90f2-7f07955c0eb6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:09.140140 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-aa26b9b0-1cb7-4db2-90f2-7f07955c0eb6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:09.156400 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-aa26b9b0-1cb7-4db2-90f2-7f07955c0eb6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:09.156904 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-aa26b9b0-1cb7-4db2-90f2-7f07955c0eb6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:09.159494 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-aa26b9b0-1cb7-4db2-90f2-7f07955c0eb6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:09.160099 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-aa26b9b0-1cb7-4db2-90f2-7f07955c0eb6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:09.174512 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-966a56dd-64d4-440f-9cb7-39fc55e6737a tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0551e3470b724193ade42d712dfcca04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e70c9c6e0d4dc8ad9911fa97233da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:09.192818 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-966a56dd-64d4-440f-9cb7-39fc55e6737a tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] 10.222.0.41 "GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8" status: 200 len: 1315 microversion: 2.1 time: 1.080918 Sep 02 17:09:09.197861 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 35/68] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:08 2021] GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8 => generated 1315 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:09.408541 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-8745ce87-bea5-4a55-9624-1eebfad5344d tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:09.409540 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-8745ce87-bea5-4a55-9624-1eebfad5344d tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:09.418829 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8745ce87-bea5-4a55-9624-1eebfad5344d tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:09.419290 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8745ce87-bea5-4a55-9624-1eebfad5344d tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:09.425818 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8745ce87-bea5-4a55-9624-1eebfad5344d tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:09.426285 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8745ce87-bea5-4a55-9624-1eebfad5344d tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:09.482510 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-aa26b9b0-1cb7-4db2-90f2-7f07955c0eb6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:09.497705 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-aa26b9b0-1cb7-4db2-90f2-7f07955c0eb6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:09.502096 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-aa26b9b0-1cb7-4db2-90f2-7f07955c0eb6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:09.504451 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-aa26b9b0-1cb7-4db2-90f2-7f07955c0eb6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1338 microversion: 2.20 time: 0.370543 Sep 02 17:09:09.508336 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 34/69] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:09:09 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1338 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:09:09.608266 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-8745ce87-bea5-4a55-9624-1eebfad5344d tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:09.620037 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-8745ce87-bea5-4a55-9624-1eebfad5344d tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1280 microversion: 2.1 time: 0.214099 Sep 02 17:09:09.622042 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 36/70] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:09 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1280 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:09:09.748909 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-e27c3853-a45d-4c64-b713-9f246f8dd273 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:09.750544 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-e27c3853-a45d-4c64-b713-9f246f8dd273 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:09.760857 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e27c3853-a45d-4c64-b713-9f246f8dd273 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:09.761842 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e27c3853-a45d-4c64-b713-9f246f8dd273 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:09.763409 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e27c3853-a45d-4c64-b713-9f246f8dd273 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:09.764034 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e27c3853-a45d-4c64-b713-9f246f8dd273 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:09.866658 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-3e85aa95-d3ab-42f8-9c75-50c0c4ee3dcb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:09.867474 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-3e85aa95-d3ab-42f8-9c75-50c0c4ee3dcb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:09.885539 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3e85aa95-d3ab-42f8-9c75-50c0c4ee3dcb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:09.885995 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3e85aa95-d3ab-42f8-9c75-50c0c4ee3dcb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:09.891686 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3e85aa95-d3ab-42f8-9c75-50c0c4ee3dcb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:09.892656 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3e85aa95-d3ab-42f8-9c75-50c0c4ee3dcb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:10.211827 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-3e85aa95-d3ab-42f8-9c75-50c0c4ee3dcb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:10.223236 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-3e85aa95-d3ab-42f8-9c75-50c0c4ee3dcb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1290 microversion: 2.1 time: 0.367983 Sep 02 17:09:10.242380 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 37/71] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:09 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1290 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:10.278186 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-bc408bd8-7a3e-4621-b9f5-a1201cc5bc35 req-c1a91b23-d477-4eaf-b78c-6780410ba858 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "089cf4bd-25a6-4572-a20b-99c71430e5f8", "tag": "d0ba3007-01f9-488b-88b7-3d6c6288a03e"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:10.287722 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:09:10.287722 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:09:10.330122 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-bc408bd8-7a3e-4621-b9f5-a1201cc5bc35 req-c1a91b23-d477-4eaf-b78c-6780410ba858 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:10.333095 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-bc408bd8-7a3e-4621-b9f5-a1201cc5bc35 req-c1a91b23-d477-4eaf-b78c-6780410ba858 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:10.378354 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-bc408bd8-7a3e-4621-b9f5-a1201cc5bc35 req-c1a91b23-d477-4eaf-b78c-6780410ba858 service nova] Creating event network-changed:d0ba3007-01f9-488b-88b7-3d6c6288a03e for instance 089cf4bd-25a6-4572-a20b-99c71430e5f8 on hv-cinder-80626 Sep 02 17:09:10.392278 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-bc408bd8-7a3e-4621-b9f5-a1201cc5bc35 req-c1a91b23-d477-4eaf-b78c-6780410ba858 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145349 Sep 02 17:09:10.392876 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 38/72] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:09:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:09:10.406649 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-52e81ee2-4b65-4d81-af1e-b6cbe669c433 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:10.407583 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-52e81ee2-4b65-4d81-af1e-b6cbe669c433 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] [instance: 731fe663-d306-40c9-bc5b-af255b67d8d8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:10.420209 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-52e81ee2-4b65-4d81-af1e-b6cbe669c433 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:10.420657 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-52e81ee2-4b65-4d81-af1e-b6cbe669c433 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:10.421449 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-52e81ee2-4b65-4d81-af1e-b6cbe669c433 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:10.421947 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-52e81ee2-4b65-4d81-af1e-b6cbe669c433 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:10.434530 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-e27c3853-a45d-4c64-b713-9f246f8dd273 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:10.451452 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-e27c3853-a45d-4c64-b713-9f246f8dd273 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97" status: 200 len: 1318 microversion: 2.1 time: 0.705760 Sep 02 17:09:10.454737 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 35/73] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:09 2021] GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 => generated 1318 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:10.527917 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-3c05c922-abd6-4f75-a38f-1ff88d596e12 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:10.528627 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-3c05c922-abd6-4f75-a38f-1ff88d596e12 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:10.538177 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3c05c922-abd6-4f75-a38f-1ff88d596e12 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:10.539608 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3c05c922-abd6-4f75-a38f-1ff88d596e12 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:10.542454 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3c05c922-abd6-4f75-a38f-1ff88d596e12 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:10.543107 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3c05c922-abd6-4f75-a38f-1ff88d596e12 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:10.631836 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-3c05c922-abd6-4f75-a38f-1ff88d596e12 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:10.649880 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-3c05c922-abd6-4f75-a38f-1ff88d596e12 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:10.655087 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-3c05c922-abd6-4f75-a38f-1ff88d596e12 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:10.660268 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-3c05c922-abd6-4f75-a38f-1ff88d596e12 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1338 microversion: 2.20 time: 0.137050 Sep 02 17:09:10.672287 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 36/74] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:09:10 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1338 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:09:10.679225 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-000bccc3-d3e2-4ff8-ba9e-e7e1866df0e9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:10.680029 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-000bccc3-d3e2-4ff8-ba9e-e7e1866df0e9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:10.689436 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-000bccc3-d3e2-4ff8-ba9e-e7e1866df0e9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:10.690993 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-000bccc3-d3e2-4ff8-ba9e-e7e1866df0e9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:10.695527 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-000bccc3-d3e2-4ff8-ba9e-e7e1866df0e9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:10.696815 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-000bccc3-d3e2-4ff8-ba9e-e7e1866df0e9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:10.983298 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-000bccc3-d3e2-4ff8-ba9e-e7e1866df0e9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:10.998270 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-000bccc3-d3e2-4ff8-ba9e-e7e1866df0e9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1322 microversion: 2.1 time: 0.321687 Sep 02 17:09:10.999283 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 37/75] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:10 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1322 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:11.241728 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-7f7529da-06dc-45a7-9838-ce98adbb751a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:11.242677 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-7f7529da-06dc-45a7-9838-ce98adbb751a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:11.261571 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7f7529da-06dc-45a7-9838-ce98adbb751a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:11.262196 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7f7529da-06dc-45a7-9838-ce98adbb751a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:11.263297 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7f7529da-06dc-45a7-9838-ce98adbb751a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:11.263822 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7f7529da-06dc-45a7-9838-ce98adbb751a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:11.404253 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-7f7529da-06dc-45a7-9838-ce98adbb751a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:11.414767 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-7f7529da-06dc-45a7-9838-ce98adbb751a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1296 microversion: 2.1 time: 0.174368 Sep 02 17:09:11.419162 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 38/76] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:11 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1296 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:11.472454 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-e691d906-4cbb-42a7-9afa-a7ad65be3716 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:11.473214 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-e691d906-4cbb-42a7-9afa-a7ad65be3716 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:11.488256 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e691d906-4cbb-42a7-9afa-a7ad65be3716 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:11.489069 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e691d906-4cbb-42a7-9afa-a7ad65be3716 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:11.490106 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e691d906-4cbb-42a7-9afa-a7ad65be3716 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:11.490724 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e691d906-4cbb-42a7-9afa-a7ad65be3716 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:11.789332 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-52e81ee2-4b65-4d81-af1e-b6cbe669c433 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0551e3470b724193ade42d712dfcca04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e70c9c6e0d4dc8ad9911fa97233da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:11.802837 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-52e81ee2-4b65-4d81-af1e-b6cbe669c433 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] 10.222.0.41 "GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8" status: 200 len: 1315 microversion: 2.1 time: 1.408252 Sep 02 17:09:11.803558 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 39/77] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:10 2021] GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8 => generated 1315 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:11.814115 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-29ec5fdd-db6c-4ab4-b01c-8c939103c5cb tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:11.816672 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-29ec5fdd-db6c-4ab4-b01c-8c939103c5cb tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:11.827455 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-29ec5fdd-db6c-4ab4-b01c-8c939103c5cb tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:11.828134 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-29ec5fdd-db6c-4ab4-b01c-8c939103c5cb tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:11.829106 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-29ec5fdd-db6c-4ab4-b01c-8c939103c5cb tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:11.829686 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-29ec5fdd-db6c-4ab4-b01c-8c939103c5cb tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:11.885334 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-e691d906-4cbb-42a7-9afa-a7ad65be3716 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:11.902034 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-e691d906-4cbb-42a7-9afa-a7ad65be3716 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97" status: 200 len: 1318 microversion: 2.1 time: 0.435270 Sep 02 17:09:11.903292 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 39/78] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:11 2021] GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 => generated 1318 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:11.969620 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-29ec5fdd-db6c-4ab4-b01c-8c939103c5cb tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:12.003112 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-29ec5fdd-db6c-4ab4-b01c-8c939103c5cb tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:12.004845 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-29ec5fdd-db6c-4ab4-b01c-8c939103c5cb tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:12.005964 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-29ec5fdd-db6c-4ab4-b01c-8c939103c5cb tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1338 microversion: 2.20 time: 0.200785 Sep 02 17:09:12.016659 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-e8c3d5fc-11b9-47b4-bb8e-72262b0d51ef tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:12.018215 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-e8c3d5fc-11b9-47b4-bb8e-72262b0d51ef tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:12.025322 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 40/79] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:09:11 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1338 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:09:12.035808 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e8c3d5fc-11b9-47b4-bb8e-72262b0d51ef tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:12.036438 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e8c3d5fc-11b9-47b4-bb8e-72262b0d51ef tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:12.037257 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e8c3d5fc-11b9-47b4-bb8e-72262b0d51ef tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:12.037647 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e8c3d5fc-11b9-47b4-bb8e-72262b0d51ef tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:12.265757 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-08a8dec3-b3c1-4533-bab2-bd52f029f927 req-b72094c9-1676-48ca-a5f5-37f63a945e4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8c6e69a-9463-455b-b782-db0bcadacc9e", "tag": "78ccaec8-38fe-4511-a0ec-b9b938bb39a5"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:12.269578 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:09:12.269578 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:09:12.282233 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-08a8dec3-b3c1-4533-bab2-bd52f029f927 req-b72094c9-1676-48ca-a5f5-37f63a945e4f service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:12.283640 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-08a8dec3-b3c1-4533-bab2-bd52f029f927 req-b72094c9-1676-48ca-a5f5-37f63a945e4f service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:12.300511 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-08a8dec3-b3c1-4533-bab2-bd52f029f927 req-b72094c9-1676-48ca-a5f5-37f63a945e4f service nova] Creating event network-changed:78ccaec8-38fe-4511-a0ec-b9b938bb39a5 for instance e8c6e69a-9463-455b-b782-db0bcadacc9e on hv-cinder-80626 Sep 02 17:09:12.309487 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-08a8dec3-b3c1-4533-bab2-bd52f029f927 req-b72094c9-1676-48ca-a5f5-37f63a945e4f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048569 Sep 02 17:09:12.311038 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 41/80] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:09:12 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:09:12.402370 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-e8c3d5fc-11b9-47b4-bb8e-72262b0d51ef tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:12.410260 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-e8c3d5fc-11b9-47b4-bb8e-72262b0d51ef tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1322 microversion: 2.1 time: 0.398221 Sep 02 17:09:12.420377 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 40/81] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:12 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1322 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:12.451517 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-ca777337-e412-4721-a65b-2b735dae3a56 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:12.452328 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-ca777337-e412-4721-a65b-2b735dae3a56 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:12.464090 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ca777337-e412-4721-a65b-2b735dae3a56 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:12.464441 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ca777337-e412-4721-a65b-2b735dae3a56 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:12.465419 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ca777337-e412-4721-a65b-2b735dae3a56 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:12.465851 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ca777337-e412-4721-a65b-2b735dae3a56 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:12.591172 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-ca777337-e412-4721-a65b-2b735dae3a56 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:12.594556 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-ca777337-e412-4721-a65b-2b735dae3a56 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1296 microversion: 2.1 time: 0.159593 Sep 02 17:09:12.595564 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 42/82] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:12 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1296 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:12.820017 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-cb46affe-b8b1-465e-a37a-edb57017ca6a tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:12.820648 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-cb46affe-b8b1-465e-a37a-edb57017ca6a tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] [instance: 731fe663-d306-40c9-bc5b-af255b67d8d8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:12.838765 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-cb46affe-b8b1-465e-a37a-edb57017ca6a tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:12.839473 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-cb46affe-b8b1-465e-a37a-edb57017ca6a tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:12.840440 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-cb46affe-b8b1-465e-a37a-edb57017ca6a tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:12.841075 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-cb46affe-b8b1-465e-a37a-edb57017ca6a tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:12.926263 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-c335533a-cef7-4e18-9831-27a8f486d615 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:12.931244 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-c335533a-cef7-4e18-9831-27a8f486d615 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:12.940664 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c335533a-cef7-4e18-9831-27a8f486d615 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:12.941111 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c335533a-cef7-4e18-9831-27a8f486d615 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:12.942449 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c335533a-cef7-4e18-9831-27a8f486d615 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:12.943880 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c335533a-cef7-4e18-9831-27a8f486d615 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:13.126730 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-cb46affe-b8b1-465e-a37a-edb57017ca6a tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0551e3470b724193ade42d712dfcca04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e70c9c6e0d4dc8ad9911fa97233da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:13.134494 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-cb46affe-b8b1-465e-a37a-edb57017ca6a tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] 10.222.0.41 "GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8" status: 200 len: 1315 microversion: 2.1 time: 0.317547 Sep 02 17:09:13.135322 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 41/83] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:12 2021] GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8 => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:13.140545 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-f6202e79-53fe-4042-8777-0e72ff7be819 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:13.141353 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-f6202e79-53fe-4042-8777-0e72ff7be819 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:13.147465 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f6202e79-53fe-4042-8777-0e72ff7be819 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:13.147916 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f6202e79-53fe-4042-8777-0e72ff7be819 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:13.148684 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f6202e79-53fe-4042-8777-0e72ff7be819 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:13.149116 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f6202e79-53fe-4042-8777-0e72ff7be819 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:13.379722 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-f6202e79-53fe-4042-8777-0e72ff7be819 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:13.395258 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-f6202e79-53fe-4042-8777-0e72ff7be819 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:13.397970 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-f6202e79-53fe-4042-8777-0e72ff7be819 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:13.400394 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-f6202e79-53fe-4042-8777-0e72ff7be819 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1405 microversion: 2.20 time: 0.263059 Sep 02 17:09:13.423416 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 42/84] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:09:13 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1405 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:09:13.431496 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-d98297b0-7af7-48c0-bbba-516d3f284c05 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:13.432429 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-d98297b0-7af7-48c0-bbba-516d3f284c05 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:13.441120 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d98297b0-7af7-48c0-bbba-516d3f284c05 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:13.441898 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d98297b0-7af7-48c0-bbba-516d3f284c05 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:13.442951 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d98297b0-7af7-48c0-bbba-516d3f284c05 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:13.443604 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d98297b0-7af7-48c0-bbba-516d3f284c05 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:13.538224 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-c335533a-cef7-4e18-9831-27a8f486d615 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:13.548625 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-c335533a-cef7-4e18-9831-27a8f486d615 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97" status: 200 len: 1318 microversion: 2.1 time: 0.634066 Sep 02 17:09:13.557218 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 43/85] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:12 2021] GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 => generated 1318 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:13.626660 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-3c92085b-7ed2-4dae-9b61-da5c2f2f95b0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:13.629824 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-3c92085b-7ed2-4dae-9b61-da5c2f2f95b0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:13.657212 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3c92085b-7ed2-4dae-9b61-da5c2f2f95b0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:13.659206 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3c92085b-7ed2-4dae-9b61-da5c2f2f95b0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:13.661092 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3c92085b-7ed2-4dae-9b61-da5c2f2f95b0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:13.671114 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3c92085b-7ed2-4dae-9b61-da5c2f2f95b0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:13.957693 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-d98297b0-7af7-48c0-bbba-516d3f284c05 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:13.973746 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-d98297b0-7af7-48c0-bbba-516d3f284c05 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1322 microversion: 2.1 time: 0.543885 Sep 02 17:09:13.976247 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 43/86] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:13 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1322 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:14.151599 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-c417fc03-0421-4d1e-b265-7b91f7e41560 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:14.152354 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-c417fc03-0421-4d1e-b265-7b91f7e41560 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] [instance: 731fe663-d306-40c9-bc5b-af255b67d8d8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:14.163953 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c417fc03-0421-4d1e-b265-7b91f7e41560 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:14.164416 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c417fc03-0421-4d1e-b265-7b91f7e41560 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:14.165233 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c417fc03-0421-4d1e-b265-7b91f7e41560 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:14.165668 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c417fc03-0421-4d1e-b265-7b91f7e41560 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:14.397018 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-c417fc03-0421-4d1e-b265-7b91f7e41560 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0551e3470b724193ade42d712dfcca04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e70c9c6e0d4dc8ad9911fa97233da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:14.407269 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-c417fc03-0421-4d1e-b265-7b91f7e41560 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] 10.222.0.41 "GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8" status: 200 len: 1315 microversion: 2.1 time: 0.259337 Sep 02 17:09:14.421946 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 44/87] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:14 2021] GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8 => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:09:14.421946 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-c39786c3-64eb-47bf-bb03-babdf7ec891c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:14.422940 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-c39786c3-64eb-47bf-bb03-babdf7ec891c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:14.434338 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c39786c3-64eb-47bf-bb03-babdf7ec891c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:14.435141 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c39786c3-64eb-47bf-bb03-babdf7ec891c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:14.436131 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c39786c3-64eb-47bf-bb03-babdf7ec891c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:14.436765 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c39786c3-64eb-47bf-bb03-babdf7ec891c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:14.596777 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-c39786c3-64eb-47bf-bb03-babdf7ec891c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:14.605187 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-c39786c3-64eb-47bf-bb03-babdf7ec891c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:14.607787 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-c39786c3-64eb-47bf-bb03-babdf7ec891c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:14.609322 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-c39786c3-64eb-47bf-bb03-babdf7ec891c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1405 microversion: 2.20 time: 0.194182 Sep 02 17:09:14.610339 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 45/88] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:09:14 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1405 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:09:14.617451 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-7f288e84-7099-4494-a087-5e1837dfbbeb tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:14.619022 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-7f288e84-7099-4494-a087-5e1837dfbbeb tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:14.625948 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7f288e84-7099-4494-a087-5e1837dfbbeb tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:14.626387 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7f288e84-7099-4494-a087-5e1837dfbbeb tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:14.627206 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7f288e84-7099-4494-a087-5e1837dfbbeb tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:14.627636 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7f288e84-7099-4494-a087-5e1837dfbbeb tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:14.716805 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-3c92085b-7ed2-4dae-9b61-da5c2f2f95b0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:14.728539 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-3c92085b-7ed2-4dae-9b61-da5c2f2f95b0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1363 microversion: 2.1 time: 1.119505 Sep 02 17:09:14.729757 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 44/89] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:13 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1363 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:14.810777 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-7f288e84-7099-4494-a087-5e1837dfbbeb tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:14.820406 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-7f288e84-7099-4494-a087-5e1837dfbbeb tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97" status: 200 len: 1318 microversion: 2.1 time: 0.208153 Sep 02 17:09:14.821608 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 46/90] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:14 2021] GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:14.992774 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-f1e3b4df-a65f-4fbd-86dd-ccf46e1ceef6 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:14.993754 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-f1e3b4df-a65f-4fbd-86dd-ccf46e1ceef6 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:15.026897 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f1e3b4df-a65f-4fbd-86dd-ccf46e1ceef6 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:15.027367 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f1e3b4df-a65f-4fbd-86dd-ccf46e1ceef6 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:15.034795 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f1e3b4df-a65f-4fbd-86dd-ccf46e1ceef6 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:15.035478 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f1e3b4df-a65f-4fbd-86dd-ccf46e1ceef6 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:15.436497 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-d4647723-c4ad-48f1-810d-0dab1ff4d683 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:15.438178 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-d4647723-c4ad-48f1-810d-0dab1ff4d683 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] [instance: 731fe663-d306-40c9-bc5b-af255b67d8d8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:15.445832 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d4647723-c4ad-48f1-810d-0dab1ff4d683 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:15.446966 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d4647723-c4ad-48f1-810d-0dab1ff4d683 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:15.448269 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d4647723-c4ad-48f1-810d-0dab1ff4d683 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:15.448968 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d4647723-c4ad-48f1-810d-0dab1ff4d683 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:15.717455 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-d4647723-c4ad-48f1-810d-0dab1ff4d683 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0551e3470b724193ade42d712dfcca04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e70c9c6e0d4dc8ad9911fa97233da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:15.726990 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-d4647723-c4ad-48f1-810d-0dab1ff4d683 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] 10.222.0.41 "GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8" status: 200 len: 1315 microversion: 2.1 time: 0.294736 Sep 02 17:09:15.728648 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 47/91] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:15 2021] GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8 => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:15.744921 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-82a78485-211f-476a-bfdf-88d610846ca5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:15.747327 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-82a78485-211f-476a-bfdf-88d610846ca5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:15.765986 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-82a78485-211f-476a-bfdf-88d610846ca5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:15.770103 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-82a78485-211f-476a-bfdf-88d610846ca5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:15.774961 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-82a78485-211f-476a-bfdf-88d610846ca5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:15.776066 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-82a78485-211f-476a-bfdf-88d610846ca5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:15.792735 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-f1e3b4df-a65f-4fbd-86dd-ccf46e1ceef6 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:15.801855 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-f1e3b4df-a65f-4fbd-86dd-ccf46e1ceef6 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1322 microversion: 2.1 time: 0.812828 Sep 02 17:09:15.807127 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 45/92] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:14 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1322 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:15.822476 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-8d089f51-7e90-4d81-b185-19e3a6650d6a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:15.832841 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-8d089f51-7e90-4d81-b185-19e3a6650d6a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:15.883899 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8d089f51-7e90-4d81-b185-19e3a6650d6a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:15.885343 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8d089f51-7e90-4d81-b185-19e3a6650d6a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:15.890613 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8d089f51-7e90-4d81-b185-19e3a6650d6a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:15.891323 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8d089f51-7e90-4d81-b185-19e3a6650d6a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:16.206482 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-82a78485-211f-476a-bfdf-88d610846ca5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:16.220202 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-82a78485-211f-476a-bfdf-88d610846ca5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:16.222003 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-82a78485-211f-476a-bfdf-88d610846ca5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:16.231809 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-82a78485-211f-476a-bfdf-88d610846ca5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1405 microversion: 2.20 time: 0.501468 Sep 02 17:09:16.249089 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 48/93] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:09:15 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1405 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:09:16.677948 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [req-d46e0c8a-c5b2-4a5c-8788-3a610da65e3f req-837ea5fb-0652-4809-9a8e-54d3081d026e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "731fe663-d306-40c9-bc5b-af255b67d8d8", "name": "network-vif-plugged", "status": "completed", "tag": "84985843-a05d-4eec-a8e6-63d146fd1bf1"}]} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:16.680816 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:09:16.680816 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: warnings.warn(msg) Sep 02 17:09:16.693078 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-d46e0c8a-c5b2-4a5c-8788-3a610da65e3f req-837ea5fb-0652-4809-9a8e-54d3081d026e service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:16.695108 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-d46e0c8a-c5b2-4a5c-8788-3a610da65e3f req-837ea5fb-0652-4809-9a8e-54d3081d026e service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:16.728829 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.compute.server_external_events [req-d46e0c8a-c5b2-4a5c-8788-3a610da65e3f req-837ea5fb-0652-4809-9a8e-54d3081d026e service nova] Creating event network-vif-plugged:84985843-a05d-4eec-a8e6-63d146fd1bf1 for instance 731fe663-d306-40c9-bc5b-af255b67d8d8 on hv-cinder-80626 Sep 02 17:09:16.742831 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [req-d46e0c8a-c5b2-4a5c-8788-3a610da65e3f req-837ea5fb-0652-4809-9a8e-54d3081d026e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.487525 Sep 02 17:09:16.743797 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 49/94] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:09:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:09:16.753668 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-79a41521-cbd1-4984-8601-16a993a78f2b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:16.755010 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-79a41521-cbd1-4984-8601-16a993a78f2b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:16.778375 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-8d089f51-7e90-4d81-b185-19e3a6650d6a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:16.798301 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-79a41521-cbd1-4984-8601-16a993a78f2b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:16.802557 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-79a41521-cbd1-4984-8601-16a993a78f2b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:16.803098 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-8d089f51-7e90-4d81-b185-19e3a6650d6a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1363 microversion: 2.1 time: 0.987474 Sep 02 17:09:16.805036 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-79a41521-cbd1-4984-8601-16a993a78f2b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:16.805851 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 46/95] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:15 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1363 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:16.806571 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-79a41521-cbd1-4984-8601-16a993a78f2b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:16.810823 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-ebd49356-32f3-4788-b43a-d95fdb7f6ba7 req-f44d9fa3-b0d6-4b5f-8b45-095462073516 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77697955-515d-4f49-8b5e-8d01b670ff58", "tag": "d6ce6dfa-70c0-4097-860a-9fdc1e531848"}, {"name": "network-changed", "server_uuid": "4e92c68a-a864-4562-b08b-d244394268ce", "tag": "0a87c875-7882-47c2-a092-e14ea53f2b64"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:16.820320 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:09:16.820320 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:09:16.838614 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-ebd49356-32f3-4788-b43a-d95fdb7f6ba7 req-f44d9fa3-b0d6-4b5f-8b45-095462073516 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:16.839763 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-ebd49356-32f3-4788-b43a-d95fdb7f6ba7 req-f44d9fa3-b0d6-4b5f-8b45-095462073516 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:16.866965 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-ebd49356-32f3-4788-b43a-d95fdb7f6ba7 req-f44d9fa3-b0d6-4b5f-8b45-095462073516 service nova] Creating event network-changed:d6ce6dfa-70c0-4097-860a-9fdc1e531848 for instance 77697955-515d-4f49-8b5e-8d01b670ff58 on hv-cinder-80626 Sep 02 17:09:16.868758 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-ebd49356-32f3-4788-b43a-d95fdb7f6ba7 req-f44d9fa3-b0d6-4b5f-8b45-095462073516 service nova] Creating event network-changed:0a87c875-7882-47c2-a092-e14ea53f2b64 for instance 4e92c68a-a864-4562-b08b-d244394268ce on hv-cinder-80626 Sep 02 17:09:16.878422 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-ebd49356-32f3-4788-b43a-d95fdb7f6ba7 req-f44d9fa3-b0d6-4b5f-8b45-095462073516 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.071058 Sep 02 17:09:16.892258 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 47/96] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:09:16 2021] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:09:16.910295 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-25f1aa5c-24c7-47e4-8e2d-cd413f3a900a tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:16.912714 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-25f1aa5c-24c7-47e4-8e2d-cd413f3a900a tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] [instance: 731fe663-d306-40c9-bc5b-af255b67d8d8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:16.926203 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-25f1aa5c-24c7-47e4-8e2d-cd413f3a900a tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:16.927023 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-25f1aa5c-24c7-47e4-8e2d-cd413f3a900a tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:16.928016 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-25f1aa5c-24c7-47e4-8e2d-cd413f3a900a tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:16.933140 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-25f1aa5c-24c7-47e4-8e2d-cd413f3a900a tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:17.128997 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-79a41521-cbd1-4984-8601-16a993a78f2b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:17.141143 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-79a41521-cbd1-4984-8601-16a993a78f2b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97" status: 200 len: 1318 microversion: 2.1 time: 0.393780 Sep 02 17:09:17.143897 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 50/97] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:16 2021] GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 => generated 1318 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:17.149094 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-eda8e6c5-87be-44c5-8baa-002835a06307 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:17.149906 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-eda8e6c5-87be-44c5-8baa-002835a06307 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:17.157414 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-eda8e6c5-87be-44c5-8baa-002835a06307 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:17.158088 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-eda8e6c5-87be-44c5-8baa-002835a06307 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:17.159072 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-eda8e6c5-87be-44c5-8baa-002835a06307 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:17.165736 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-eda8e6c5-87be-44c5-8baa-002835a06307 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:17.356235 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-25f1aa5c-24c7-47e4-8e2d-cd413f3a900a tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0551e3470b724193ade42d712dfcca04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e70c9c6e0d4dc8ad9911fa97233da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:17.362457 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-eda8e6c5-87be-44c5-8baa-002835a06307 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:17.367070 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-25f1aa5c-24c7-47e4-8e2d-cd413f3a900a tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] 10.222.0.41 "GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8" status: 200 len: 1315 microversion: 2.1 time: 0.472600 Sep 02 17:09:17.376377 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 48/98] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:16 2021] GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8 => generated 1315 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:17.376377 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-bb2dd17a-a28c-43fc-b152-3297f51199b8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:17.376377 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-bb2dd17a-a28c-43fc-b152-3297f51199b8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:17.379404 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bb2dd17a-a28c-43fc-b152-3297f51199b8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:17.379998 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bb2dd17a-a28c-43fc-b152-3297f51199b8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:17.380784 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bb2dd17a-a28c-43fc-b152-3297f51199b8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:17.381223 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bb2dd17a-a28c-43fc-b152-3297f51199b8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:17.381328 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-eda8e6c5-87be-44c5-8baa-002835a06307 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1322 microversion: 2.1 time: 0.235856 Sep 02 17:09:17.390653 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 51/99] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:17 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:17.511821 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-bb2dd17a-a28c-43fc-b152-3297f51199b8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:17.520709 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-bb2dd17a-a28c-43fc-b152-3297f51199b8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:17.522396 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-bb2dd17a-a28c-43fc-b152-3297f51199b8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:17.523531 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-bb2dd17a-a28c-43fc-b152-3297f51199b8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1405 microversion: 2.20 time: 0.155012 Sep 02 17:09:17.524393 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 49/100] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:09:17 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:09:17.822531 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-17d39348-ec81-4c7f-a09c-85989941070e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:17.823285 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-17d39348-ec81-4c7f-a09c-85989941070e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:17.829454 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-17d39348-ec81-4c7f-a09c-85989941070e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:17.829986 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-17d39348-ec81-4c7f-a09c-85989941070e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:17.830854 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-17d39348-ec81-4c7f-a09c-85989941070e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:17.831365 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-17d39348-ec81-4c7f-a09c-85989941070e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:18.002415 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-17d39348-ec81-4c7f-a09c-85989941070e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:18.012509 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-17d39348-ec81-4c7f-a09c-85989941070e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1363 microversion: 2.1 time: 0.193802 Sep 02 17:09:18.013428 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 52/101] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:17 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:18.160129 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-405bea9e-e3fa-4f08-b3ca-0ec808c8d778 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:18.160734 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-405bea9e-e3fa-4f08-b3ca-0ec808c8d778 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:18.166952 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-405bea9e-e3fa-4f08-b3ca-0ec808c8d778 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:18.167401 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-405bea9e-e3fa-4f08-b3ca-0ec808c8d778 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:18.168165 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-405bea9e-e3fa-4f08-b3ca-0ec808c8d778 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:18.169183 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-405bea9e-e3fa-4f08-b3ca-0ec808c8d778 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:18.305647 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-405bea9e-e3fa-4f08-b3ca-0ec808c8d778 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:18.313633 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-405bea9e-e3fa-4f08-b3ca-0ec808c8d778 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97" status: 200 len: 1318 microversion: 2.1 time: 0.157220 Sep 02 17:09:18.314251 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 50/102] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:18 2021] GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:18.384002 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-7869e332-2473-4966-bfb0-f127ad02510b tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:18.384614 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-7869e332-2473-4966-bfb0-f127ad02510b tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] [instance: 731fe663-d306-40c9-bc5b-af255b67d8d8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:18.390555 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7869e332-2473-4966-bfb0-f127ad02510b tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:18.391043 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7869e332-2473-4966-bfb0-f127ad02510b tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:18.391812 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7869e332-2473-4966-bfb0-f127ad02510b tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:18.392245 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7869e332-2473-4966-bfb0-f127ad02510b tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:18.398018 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-57c44503-f6af-4fe2-a5cd-3b8eb94cbccf tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:18.398654 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-57c44503-f6af-4fe2-a5cd-3b8eb94cbccf tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:18.404487 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-57c44503-f6af-4fe2-a5cd-3b8eb94cbccf tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:18.405136 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-57c44503-f6af-4fe2-a5cd-3b8eb94cbccf tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:18.406075 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-57c44503-f6af-4fe2-a5cd-3b8eb94cbccf tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:18.411892 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-57c44503-f6af-4fe2-a5cd-3b8eb94cbccf tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:18.533799 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-7869e332-2473-4966-bfb0-f127ad02510b tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0551e3470b724193ade42d712dfcca04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e70c9c6e0d4dc8ad9911fa97233da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:18.543764 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-7869e332-2473-4966-bfb0-f127ad02510b tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] 10.222.0.41 "GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8" status: 200 len: 1315 microversion: 2.1 time: 0.163635 Sep 02 17:09:18.548608 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 53/103] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:18 2021] GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:18.548866 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-57c44503-f6af-4fe2-a5cd-3b8eb94cbccf tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:18.550746 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-cf8edd09-de9a-4a74-b850-3eb4c97411a9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:18.551538 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-cf8edd09-de9a-4a74-b850-3eb4c97411a9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:18.556940 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-57c44503-f6af-4fe2-a5cd-3b8eb94cbccf tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1322 microversion: 2.1 time: 0.162705 Sep 02 17:09:18.557845 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 51/104] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:18 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:09:18.558751 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-cf8edd09-de9a-4a74-b850-3eb4c97411a9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:18.559693 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-cf8edd09-de9a-4a74-b850-3eb4c97411a9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:18.560205 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-cf8edd09-de9a-4a74-b850-3eb4c97411a9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:18.560646 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-cf8edd09-de9a-4a74-b850-3eb4c97411a9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:18.751683 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-cf8edd09-de9a-4a74-b850-3eb4c97411a9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:18.758912 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-479b6eb4-ea18-48c9-a625-0aa556f605bd req-7448ed56-35f0-4e06-81d6-61bea7d96cdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc38d921-f6d4-4f6c-89c1-08e1c2d96c97", "name": "network-vif-plugged", "status": "completed", "tag": "7e2fc8cd-4943-4413-bed6-883f6ed096b2"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:18.760559 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:09:18.760559 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:09:18.760685 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-cf8edd09-de9a-4a74-b850-3eb4c97411a9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:18.762147 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-cf8edd09-de9a-4a74-b850-3eb4c97411a9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:18.763425 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-cf8edd09-de9a-4a74-b850-3eb4c97411a9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1405 microversion: 2.20 time: 0.217841 Sep 02 17:09:18.763944 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 54/105] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:09:18 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1405 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:09:18.768138 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-479b6eb4-ea18-48c9-a625-0aa556f605bd req-7448ed56-35f0-4e06-81d6-61bea7d96cdf service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:18.768571 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-479b6eb4-ea18-48c9-a625-0aa556f605bd req-7448ed56-35f0-4e06-81d6-61bea7d96cdf service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:18.780571 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-479b6eb4-ea18-48c9-a625-0aa556f605bd req-7448ed56-35f0-4e06-81d6-61bea7d96cdf service nova] Creating event network-vif-plugged:7e2fc8cd-4943-4413-bed6-883f6ed096b2 for instance fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 on hv-cinder-80626 Sep 02 17:09:18.785428 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-479b6eb4-ea18-48c9-a625-0aa556f605bd req-7448ed56-35f0-4e06-81d6-61bea7d96cdf service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030956 Sep 02 17:09:18.786008 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 52/106] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:09:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:09:19.029529 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-62b48b72-1b37-44c5-8edd-b6ed451b2db7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:19.030868 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-62b48b72-1b37-44c5-8edd-b6ed451b2db7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:19.037982 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-62b48b72-1b37-44c5-8edd-b6ed451b2db7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:19.038889 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-62b48b72-1b37-44c5-8edd-b6ed451b2db7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:19.040032 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-62b48b72-1b37-44c5-8edd-b6ed451b2db7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:19.040543 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-62b48b72-1b37-44c5-8edd-b6ed451b2db7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:19.160279 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-62b48b72-1b37-44c5-8edd-b6ed451b2db7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:19.167393 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-62b48b72-1b37-44c5-8edd-b6ed451b2db7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1363 microversion: 2.1 time: 0.141678 Sep 02 17:09:19.167944 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 55/107] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:19 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1363 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:19.330264 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-a62557f3-1fd3-488d-a7bf-a12285e9f8cd tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:19.331701 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-a62557f3-1fd3-488d-a7bf-a12285e9f8cd tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:19.337734 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a62557f3-1fd3-488d-a7bf-a12285e9f8cd tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:19.338404 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a62557f3-1fd3-488d-a7bf-a12285e9f8cd tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:19.339201 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a62557f3-1fd3-488d-a7bf-a12285e9f8cd tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:19.339633 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a62557f3-1fd3-488d-a7bf-a12285e9f8cd tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:19.465611 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-a62557f3-1fd3-488d-a7bf-a12285e9f8cd tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:19.472911 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-a62557f3-1fd3-488d-a7bf-a12285e9f8cd tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97" status: 200 len: 1318 microversion: 2.1 time: 0.146938 Sep 02 17:09:19.473474 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 53/108] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:19 2021] GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:19.560595 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-b3f425af-bdbc-401e-ba1e-7f584b22f2a1 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:19.561205 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-b3f425af-bdbc-401e-ba1e-7f584b22f2a1 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] [instance: 731fe663-d306-40c9-bc5b-af255b67d8d8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:19.567178 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b3f425af-bdbc-401e-ba1e-7f584b22f2a1 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:19.567620 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b3f425af-bdbc-401e-ba1e-7f584b22f2a1 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:19.568381 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b3f425af-bdbc-401e-ba1e-7f584b22f2a1 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:19.568803 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b3f425af-bdbc-401e-ba1e-7f584b22f2a1 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:19.573839 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-c162aece-023b-489a-b242-bc7b4e8a326e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:19.574446 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-c162aece-023b-489a-b242-bc7b4e8a326e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:19.580193 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c162aece-023b-489a-b242-bc7b4e8a326e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:19.580638 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c162aece-023b-489a-b242-bc7b4e8a326e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:19.581502 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c162aece-023b-489a-b242-bc7b4e8a326e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:19.581936 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c162aece-023b-489a-b242-bc7b4e8a326e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:19.694806 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-b3f425af-bdbc-401e-ba1e-7f584b22f2a1 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0551e3470b724193ade42d712dfcca04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e70c9c6e0d4dc8ad9911fa97233da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:19.702855 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-b3f425af-bdbc-401e-ba1e-7f584b22f2a1 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] 10.222.0.41 "GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8" status: 200 len: 1315 microversion: 2.1 time: 0.145685 Sep 02 17:09:19.703430 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 56/109] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:19 2021] GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:09:19.714948 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-c162aece-023b-489a-b242-bc7b4e8a326e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:19.722119 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-c162aece-023b-489a-b242-bc7b4e8a326e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1322 microversion: 2.1 time: 0.152780 Sep 02 17:09:19.722695 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 54/110] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:19 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:09:19.780825 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-bcd3b10c-3a53-4261-88f8-0b70f7272fad tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:19.781633 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-bcd3b10c-3a53-4261-88f8-0b70f7272fad tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:19.788316 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-bcd3b10c-3a53-4261-88f8-0b70f7272fad tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:19.788976 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-bcd3b10c-3a53-4261-88f8-0b70f7272fad tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:19.789910 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-bcd3b10c-3a53-4261-88f8-0b70f7272fad tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:19.790880 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-bcd3b10c-3a53-4261-88f8-0b70f7272fad tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:19.923937 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-bcd3b10c-3a53-4261-88f8-0b70f7272fad tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:19.932015 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-bcd3b10c-3a53-4261-88f8-0b70f7272fad tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:19.933530 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-bcd3b10c-3a53-4261-88f8-0b70f7272fad tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:19.934800 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-bcd3b10c-3a53-4261-88f8-0b70f7272fad tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1405 microversion: 2.20 time: 0.157652 Sep 02 17:09:19.935724 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 57/111] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:09:19 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:09:20.186250 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-01158511-2740-4bb3-a131-42f05c72e470 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:20.187420 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-01158511-2740-4bb3-a131-42f05c72e470 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:20.194672 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-01158511-2740-4bb3-a131-42f05c72e470 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:20.195547 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-01158511-2740-4bb3-a131-42f05c72e470 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:20.197070 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-01158511-2740-4bb3-a131-42f05c72e470 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:20.198417 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-01158511-2740-4bb3-a131-42f05c72e470 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:20.489589 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-15a5648a-d369-40f1-949b-1a89585e2668 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:20.490883 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-15a5648a-d369-40f1-949b-1a89585e2668 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:20.498133 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-15a5648a-d369-40f1-949b-1a89585e2668 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:20.498937 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-15a5648a-d369-40f1-949b-1a89585e2668 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:20.500008 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-15a5648a-d369-40f1-949b-1a89585e2668 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:20.500123 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-01158511-2740-4bb3-a131-42f05c72e470 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:20.501142 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-15a5648a-d369-40f1-949b-1a89585e2668 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:20.513152 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-01158511-2740-4bb3-a131-42f05c72e470 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1363 microversion: 2.1 time: 0.331842 Sep 02 17:09:20.513817 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 55/112] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:20 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1363 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:09:20.662518 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-15a5648a-d369-40f1-949b-1a89585e2668 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:20.678835 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-15a5648a-d369-40f1-949b-1a89585e2668 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97" status: 200 len: 1318 microversion: 2.1 time: 0.185110 Sep 02 17:09:20.678835 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 58/113] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:20 2021] GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 => generated 1318 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:09:20.719424 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-bcad02ac-52f5-4a32-93c5-a15dec796649 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:20.720029 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-bcad02ac-52f5-4a32-93c5-a15dec796649 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] [instance: 731fe663-d306-40c9-bc5b-af255b67d8d8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:20.725843 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bcad02ac-52f5-4a32-93c5-a15dec796649 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:20.726292 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bcad02ac-52f5-4a32-93c5-a15dec796649 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:20.727103 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bcad02ac-52f5-4a32-93c5-a15dec796649 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:20.728079 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bcad02ac-52f5-4a32-93c5-a15dec796649 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:20.739338 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-3deabd7f-8be3-410d-bd6a-328097338efb tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:20.739936 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-3deabd7f-8be3-410d-bd6a-328097338efb tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:20.746479 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3deabd7f-8be3-410d-bd6a-328097338efb tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:20.746924 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3deabd7f-8be3-410d-bd6a-328097338efb tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:20.747674 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3deabd7f-8be3-410d-bd6a-328097338efb tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:20.748098 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3deabd7f-8be3-410d-bd6a-328097338efb tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:20.856904 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-bcad02ac-52f5-4a32-93c5-a15dec796649 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0551e3470b724193ade42d712dfcca04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e70c9c6e0d4dc8ad9911fa97233da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:20.868065 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-bcad02ac-52f5-4a32-93c5-a15dec796649 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] 10.222.0.41 "GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8" status: 200 len: 1315 microversion: 2.1 time: 0.152100 Sep 02 17:09:20.868906 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 56/114] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:20 2021] GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:20.875467 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-3deabd7f-8be3-410d-bd6a-328097338efb tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:20.882942 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-3deabd7f-8be3-410d-bd6a-328097338efb tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1322 microversion: 2.1 time: 0.147129 Sep 02 17:09:20.883810 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 59/115] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:20 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:09:20.952973 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-a748fc0c-f2fa-4fdb-94a8-e1c198d1d375 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:20.953583 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-a748fc0c-f2fa-4fdb-94a8-e1c198d1d375 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:20.959337 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a748fc0c-f2fa-4fdb-94a8-e1c198d1d375 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:20.959853 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a748fc0c-f2fa-4fdb-94a8-e1c198d1d375 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:20.960653 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a748fc0c-f2fa-4fdb-94a8-e1c198d1d375 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:20.961151 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a748fc0c-f2fa-4fdb-94a8-e1c198d1d375 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:21.092359 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-a748fc0c-f2fa-4fdb-94a8-e1c198d1d375 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:21.100584 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-a748fc0c-f2fa-4fdb-94a8-e1c198d1d375 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:21.102096 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-a748fc0c-f2fa-4fdb-94a8-e1c198d1d375 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:21.103870 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-a748fc0c-f2fa-4fdb-94a8-e1c198d1d375 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1405 microversion: 2.20 time: 0.154735 Sep 02 17:09:21.104465 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 57/116] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:09:20 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:09:21.529709 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-06420c56-2775-4cba-8847-284f347db347 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:21.530233 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-06420c56-2775-4cba-8847-284f347db347 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:21.536194 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-06420c56-2775-4cba-8847-284f347db347 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:21.536646 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-06420c56-2775-4cba-8847-284f347db347 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:21.537412 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-06420c56-2775-4cba-8847-284f347db347 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:21.537842 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-06420c56-2775-4cba-8847-284f347db347 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:21.658307 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-06420c56-2775-4cba-8847-284f347db347 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:21.665736 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-06420c56-2775-4cba-8847-284f347db347 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1363 microversion: 2.1 time: 0.139796 Sep 02 17:09:21.666888 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 60/117] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:21 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1363 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:21.687250 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-9b6019be-4103-4ded-bc10-7b1972335d11 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:21.687854 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-9b6019be-4103-4ded-bc10-7b1972335d11 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:21.693613 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9b6019be-4103-4ded-bc10-7b1972335d11 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:21.694055 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9b6019be-4103-4ded-bc10-7b1972335d11 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:21.694857 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9b6019be-4103-4ded-bc10-7b1972335d11 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:21.695286 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9b6019be-4103-4ded-bc10-7b1972335d11 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:21.816238 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-9b6019be-4103-4ded-bc10-7b1972335d11 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:21.823469 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-9b6019be-4103-4ded-bc10-7b1972335d11 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97" status: 200 len: 1318 microversion: 2.1 time: 0.139976 Sep 02 17:09:21.824023 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 58/118] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:21 2021] GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 => generated 1318 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:21.885196 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-9b93e413-74c3-4ab9-8adc-52f2d6dc211e tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:21.885804 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-9b93e413-74c3-4ab9-8adc-52f2d6dc211e tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] [instance: 731fe663-d306-40c9-bc5b-af255b67d8d8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:21.891940 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9b93e413-74c3-4ab9-8adc-52f2d6dc211e tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:21.892390 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9b93e413-74c3-4ab9-8adc-52f2d6dc211e tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:21.893317 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9b93e413-74c3-4ab9-8adc-52f2d6dc211e tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:21.893654 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9b93e413-74c3-4ab9-8adc-52f2d6dc211e tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:21.900354 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-b623f5c6-4f1a-4ed4-bacf-b4f79c67123d tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:21.901056 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-b623f5c6-4f1a-4ed4-bacf-b4f79c67123d tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:21.907054 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b623f5c6-4f1a-4ed4-bacf-b4f79c67123d tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:21.907503 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b623f5c6-4f1a-4ed4-bacf-b4f79c67123d tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:21.908273 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b623f5c6-4f1a-4ed4-bacf-b4f79c67123d tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:21.908705 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b623f5c6-4f1a-4ed4-bacf-b4f79c67123d tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:22.018868 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-9b93e413-74c3-4ab9-8adc-52f2d6dc211e tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0551e3470b724193ade42d712dfcca04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e70c9c6e0d4dc8ad9911fa97233da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:22.029516 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-9b93e413-74c3-4ab9-8adc-52f2d6dc211e tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] 10.222.0.41 "GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8" status: 200 len: 1315 microversion: 2.1 time: 0.148597 Sep 02 17:09:22.030095 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 61/119] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:21 2021] GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:22.030953 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-b623f5c6-4f1a-4ed4-bacf-b4f79c67123d tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:22.038315 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-b623f5c6-4f1a-4ed4-bacf-b4f79c67123d tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1322 microversion: 2.1 time: 0.143029 Sep 02 17:09:22.038888 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 59/120] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:21 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1322 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:09:22.121377 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-86ca5eca-475c-4070-9b08-409ab779ecaa tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:22.121980 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-86ca5eca-475c-4070-9b08-409ab779ecaa tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:22.127753 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-86ca5eca-475c-4070-9b08-409ab779ecaa tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:22.128198 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-86ca5eca-475c-4070-9b08-409ab779ecaa tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:22.128952 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-86ca5eca-475c-4070-9b08-409ab779ecaa tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:22.129382 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-86ca5eca-475c-4070-9b08-409ab779ecaa tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:22.251512 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-86ca5eca-475c-4070-9b08-409ab779ecaa tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:22.259678 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-86ca5eca-475c-4070-9b08-409ab779ecaa tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:22.261344 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-86ca5eca-475c-4070-9b08-409ab779ecaa tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:22.262456 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-86ca5eca-475c-4070-9b08-409ab779ecaa tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1405 microversion: 2.20 time: 0.144738 Sep 02 17:09:22.263059 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 62/121] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:09:22 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1405 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:09:22.683905 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-ad6839c9-5ac5-40a8-9936-062e409350ef tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:22.684510 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-ad6839c9-5ac5-40a8-9936-062e409350ef tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:22.690408 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ad6839c9-5ac5-40a8-9936-062e409350ef tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:22.691020 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ad6839c9-5ac5-40a8-9936-062e409350ef tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:22.691787 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ad6839c9-5ac5-40a8-9936-062e409350ef tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:22.692229 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ad6839c9-5ac5-40a8-9936-062e409350ef tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:22.694511 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [req-01e8c0fc-b3af-4dd6-991f-a5f97aa6bb76 req-d5b3638f-758d-4aa2-afb3-cb401378ec4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8c6e69a-9463-455b-b782-db0bcadacc9e", "name": "network-vif-plugged", "status": "completed", "tag": "78ccaec8-38fe-4511-a0ec-b9b938bb39a5"}]} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:22.697185 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:09:22.697185 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: warnings.warn(msg) Sep 02 17:09:22.704308 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-01e8c0fc-b3af-4dd6-991f-a5f97aa6bb76 req-d5b3638f-758d-4aa2-afb3-cb401378ec4e service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:22.704755 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-01e8c0fc-b3af-4dd6-991f-a5f97aa6bb76 req-d5b3638f-758d-4aa2-afb3-cb401378ec4e service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:22.718304 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.compute.server_external_events [req-01e8c0fc-b3af-4dd6-991f-a5f97aa6bb76 req-d5b3638f-758d-4aa2-afb3-cb401378ec4e service nova] Creating event network-vif-plugged:78ccaec8-38fe-4511-a0ec-b9b938bb39a5 for instance e8c6e69a-9463-455b-b782-db0bcadacc9e on hv-cinder-80626 Sep 02 17:09:22.723524 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [req-01e8c0fc-b3af-4dd6-991f-a5f97aa6bb76 req-d5b3638f-758d-4aa2-afb3-cb401378ec4e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032612 Sep 02 17:09:22.724113 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 63/122] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:09:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:09:22.824140 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-ad6839c9-5ac5-40a8-9936-062e409350ef tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:22.831388 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-ad6839c9-5ac5-40a8-9936-062e409350ef tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1363 microversion: 2.1 time: 0.151762 Sep 02 17:09:22.832149 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 60/123] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:22 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:22.844256 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-f9d744e5-e95f-49f3-b5d5-1114717db28e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:22.844952 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-f9d744e5-e95f-49f3-b5d5-1114717db28e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:22.851027 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f9d744e5-e95f-49f3-b5d5-1114717db28e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:22.851480 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f9d744e5-e95f-49f3-b5d5-1114717db28e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:22.852246 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f9d744e5-e95f-49f3-b5d5-1114717db28e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:22.853216 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f9d744e5-e95f-49f3-b5d5-1114717db28e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:22.985507 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-f9d744e5-e95f-49f3-b5d5-1114717db28e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:22.992787 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-f9d744e5-e95f-49f3-b5d5-1114717db28e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97" status: 200 len: 1318 microversion: 2.1 time: 0.156159 Sep 02 17:09:22.993927 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 64/124] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:22 2021] GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:09:23.046888 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-c3d52943-be05-4cef-a408-72fd5eb5ab45 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:23.047538 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-c3d52943-be05-4cef-a408-72fd5eb5ab45 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] [instance: 731fe663-d306-40c9-bc5b-af255b67d8d8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:23.053621 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c3d52943-be05-4cef-a408-72fd5eb5ab45 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:23.054077 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c3d52943-be05-4cef-a408-72fd5eb5ab45 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:23.054517 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-40582acd-3f24-4fe5-af13-89f334199fb0 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:23.054879 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c3d52943-be05-4cef-a408-72fd5eb5ab45 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:23.055318 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c3d52943-be05-4cef-a408-72fd5eb5ab45 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:23.055498 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-40582acd-3f24-4fe5-af13-89f334199fb0 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:23.061485 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-40582acd-3f24-4fe5-af13-89f334199fb0 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:23.062118 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-40582acd-3f24-4fe5-af13-89f334199fb0 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:23.063108 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-40582acd-3f24-4fe5-af13-89f334199fb0 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:23.063758 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-40582acd-3f24-4fe5-af13-89f334199fb0 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:23.181518 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-c3d52943-be05-4cef-a408-72fd5eb5ab45 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0551e3470b724193ade42d712dfcca04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e70c9c6e0d4dc8ad9911fa97233da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:23.186054 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-40582acd-3f24-4fe5-af13-89f334199fb0 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:23.188984 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-c3d52943-be05-4cef-a408-72fd5eb5ab45 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] 10.222.0.41 "GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8" status: 200 len: 1315 microversion: 2.1 time: 0.145767 Sep 02 17:09:23.189547 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 61/125] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:23 2021] GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:23.193386 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-40582acd-3f24-4fe5-af13-89f334199fb0 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1322 microversion: 2.1 time: 0.142864 Sep 02 17:09:23.193934 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 65/126] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:23 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1322 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:09:23.280501 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-51b20c5e-55b3-4abc-947f-f0e63075ae64 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:23.281104 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-51b20c5e-55b3-4abc-947f-f0e63075ae64 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:23.287061 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-51b20c5e-55b3-4abc-947f-f0e63075ae64 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:23.287505 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-51b20c5e-55b3-4abc-947f-f0e63075ae64 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:23.288260 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-51b20c5e-55b3-4abc-947f-f0e63075ae64 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:23.288686 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-51b20c5e-55b3-4abc-947f-f0e63075ae64 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:23.410136 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-51b20c5e-55b3-4abc-947f-f0e63075ae64 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:23.418605 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-51b20c5e-55b3-4abc-947f-f0e63075ae64 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:23.420110 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-51b20c5e-55b3-4abc-947f-f0e63075ae64 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:23.421234 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-51b20c5e-55b3-4abc-947f-f0e63075ae64 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1405 microversion: 2.20 time: 0.144428 Sep 02 17:09:23.421834 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 62/127] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:09:23 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1405 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:09:23.847783 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-01d873ca-8c2e-44fa-872b-9935803bd033 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:23.848395 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-01d873ca-8c2e-44fa-872b-9935803bd033 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:23.854960 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-01d873ca-8c2e-44fa-872b-9935803bd033 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:23.855461 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-01d873ca-8c2e-44fa-872b-9935803bd033 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:23.856252 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-01d873ca-8c2e-44fa-872b-9935803bd033 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:23.856736 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-01d873ca-8c2e-44fa-872b-9935803bd033 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:23.976948 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-01d873ca-8c2e-44fa-872b-9935803bd033 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:23.985303 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-01d873ca-8c2e-44fa-872b-9935803bd033 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1363 microversion: 2.1 time: 0.140934 Sep 02 17:09:23.985889 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 66/128] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:23 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1363 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:09:24.009539 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-a9fd262f-6d3f-4d21-bbba-6f35828ad49c tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:24.010182 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-a9fd262f-6d3f-4d21-bbba-6f35828ad49c tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:24.015974 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a9fd262f-6d3f-4d21-bbba-6f35828ad49c tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:24.016498 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a9fd262f-6d3f-4d21-bbba-6f35828ad49c tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:24.017401 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a9fd262f-6d3f-4d21-bbba-6f35828ad49c tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:24.017785 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a9fd262f-6d3f-4d21-bbba-6f35828ad49c tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:24.154342 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-a9fd262f-6d3f-4d21-bbba-6f35828ad49c tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:24.162028 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-a9fd262f-6d3f-4d21-bbba-6f35828ad49c tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97" status: 200 len: 1318 microversion: 2.1 time: 0.156213 Sep 02 17:09:24.162736 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 63/129] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:24 2021] GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:24.205323 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-57610742-f019-4ec8-94e2-41e6787f377b tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:24.205925 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-57610742-f019-4ec8-94e2-41e6787f377b tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] [instance: 731fe663-d306-40c9-bc5b-af255b67d8d8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:24.210174 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-c942b29a-c645-4d4e-a103-748c7125b521 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:24.210841 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-c942b29a-c645-4d4e-a103-748c7125b521 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:24.213466 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-57610742-f019-4ec8-94e2-41e6787f377b tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:24.213466 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-57610742-f019-4ec8-94e2-41e6787f377b tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:24.214201 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-57610742-f019-4ec8-94e2-41e6787f377b tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:24.214642 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-57610742-f019-4ec8-94e2-41e6787f377b tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:24.217516 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c942b29a-c645-4d4e-a103-748c7125b521 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:24.217960 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c942b29a-c645-4d4e-a103-748c7125b521 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:24.218762 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c942b29a-c645-4d4e-a103-748c7125b521 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:24.219200 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c942b29a-c645-4d4e-a103-748c7125b521 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:24.456132 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-57610742-f019-4ec8-94e2-41e6787f377b tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0551e3470b724193ade42d712dfcca04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e70c9c6e0d4dc8ad9911fa97233da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:24.469064 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-57610742-f019-4ec8-94e2-41e6787f377b tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] 10.222.0.41 "GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8" status: 200 len: 1315 microversion: 2.1 time: 0.267166 Sep 02 17:09:24.471273 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 67/130] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:24 2021] GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:24.477924 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-5b527775-00f5-4fb7-814e-91da15272b85 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:24.479170 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-5b527775-00f5-4fb7-814e-91da15272b85 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:24.488160 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5b527775-00f5-4fb7-814e-91da15272b85 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:24.489315 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5b527775-00f5-4fb7-814e-91da15272b85 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:24.491292 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5b527775-00f5-4fb7-814e-91da15272b85 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:24.492015 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5b527775-00f5-4fb7-814e-91da15272b85 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:24.675510 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-c942b29a-c645-4d4e-a103-748c7125b521 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:24.683135 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-c942b29a-c645-4d4e-a103-748c7125b521 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1322 microversion: 2.1 time: 0.476324 Sep 02 17:09:24.698359 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 64/131] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:24 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1322 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:24.760194 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-c8321493-41a6-4adf-9c5e-bec15c35a4a5 req-748edeb9-1a27-4c43-87a3-3055a56c91a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "089cf4bd-25a6-4572-a20b-99c71430e5f8", "name": "network-vif-plugged", "status": "completed", "tag": "d0ba3007-01f9-488b-88b7-3d6c6288a03e"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:24.762857 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:09:24.762857 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:09:24.769165 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-5b527775-00f5-4fb7-814e-91da15272b85 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:24.773302 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-c8321493-41a6-4adf-9c5e-bec15c35a4a5 req-748edeb9-1a27-4c43-87a3-3055a56c91a8 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:24.773746 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-c8321493-41a6-4adf-9c5e-bec15c35a4a5 req-748edeb9-1a27-4c43-87a3-3055a56c91a8 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:24.779149 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-5b527775-00f5-4fb7-814e-91da15272b85 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:24.780962 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-5b527775-00f5-4fb7-814e-91da15272b85 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:24.782321 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-5b527775-00f5-4fb7-814e-91da15272b85 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1405 microversion: 2.20 time: 0.309853 Sep 02 17:09:24.783418 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 68/132] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:09:24 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1405 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:09:24.789697 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-c8321493-41a6-4adf-9c5e-bec15c35a4a5 req-748edeb9-1a27-4c43-87a3-3055a56c91a8 service nova] Creating event network-vif-plugged:d0ba3007-01f9-488b-88b7-3d6c6288a03e for instance 089cf4bd-25a6-4572-a20b-99c71430e5f8 on hv-cinder-80626 Sep 02 17:09:24.796285 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-c8321493-41a6-4adf-9c5e-bec15c35a4a5 req-748edeb9-1a27-4c43-87a3-3055a56c91a8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041864 Sep 02 17:09:24.797186 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 65/133] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:09:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:09:25.001116 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-5bbebf35-e8f5-4e86-bcb5-0e8bb362c9c3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:25.001971 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-5bbebf35-e8f5-4e86-bcb5-0e8bb362c9c3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:25.007846 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5bbebf35-e8f5-4e86-bcb5-0e8bb362c9c3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:25.008300 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5bbebf35-e8f5-4e86-bcb5-0e8bb362c9c3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:25.009088 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5bbebf35-e8f5-4e86-bcb5-0e8bb362c9c3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:25.009517 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5bbebf35-e8f5-4e86-bcb5-0e8bb362c9c3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:25.180262 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-77c77973-4b61-48df-8366-f30491058564 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:25.181566 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-77c77973-4b61-48df-8366-f30491058564 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:25.201222 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-5bbebf35-e8f5-4e86-bcb5-0e8bb362c9c3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:25.209773 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-5bbebf35-e8f5-4e86-bcb5-0e8bb362c9c3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1363 microversion: 2.1 time: 0.212225 Sep 02 17:09:25.210513 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 69/134] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:24 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:25.229699 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-77c77973-4b61-48df-8366-f30491058564 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:25.230257 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-77c77973-4b61-48df-8366-f30491058564 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:25.231161 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-77c77973-4b61-48df-8366-f30491058564 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:25.231605 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-77c77973-4b61-48df-8366-f30491058564 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:25.425613 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-77c77973-4b61-48df-8366-f30491058564 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:25.433091 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-77c77973-4b61-48df-8366-f30491058564 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97" status: 200 len: 1318 microversion: 2.1 time: 0.257172 Sep 02 17:09:25.433852 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 66/135] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:25 2021] GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:25.487869 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-486a6282-967a-4abd-9fd7-04f8401af3c3 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:25.488662 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-486a6282-967a-4abd-9fd7-04f8401af3c3 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] [instance: 731fe663-d306-40c9-bc5b-af255b67d8d8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:25.494457 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-486a6282-967a-4abd-9fd7-04f8401af3c3 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:25.494931 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-486a6282-967a-4abd-9fd7-04f8401af3c3 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:25.495686 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-486a6282-967a-4abd-9fd7-04f8401af3c3 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:25.496110 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-486a6282-967a-4abd-9fd7-04f8401af3c3 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:25.616135 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-486a6282-967a-4abd-9fd7-04f8401af3c3 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0551e3470b724193ade42d712dfcca04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e70c9c6e0d4dc8ad9911fa97233da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:25.623703 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-486a6282-967a-4abd-9fd7-04f8401af3c3 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] 10.222.0.41 "GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8" status: 200 len: 1315 microversion: 2.1 time: 0.139682 Sep 02 17:09:25.624263 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 70/136] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:25 2021] GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8 => generated 1315 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:25.721486 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-789689e7-c4f9-420e-a0cd-d21cd49c4bcc tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:25.722256 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-789689e7-c4f9-420e-a0cd-d21cd49c4bcc tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:25.728414 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-789689e7-c4f9-420e-a0cd-d21cd49c4bcc tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:25.728861 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-789689e7-c4f9-420e-a0cd-d21cd49c4bcc tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:25.729633 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-789689e7-c4f9-420e-a0cd-d21cd49c4bcc tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:25.730065 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-789689e7-c4f9-420e-a0cd-d21cd49c4bcc tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:25.802361 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-254b43ec-d5c0-4c55-9f6c-983e06313da2 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:25.803009 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-254b43ec-d5c0-4c55-9f6c-983e06313da2 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:25.810972 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-254b43ec-d5c0-4c55-9f6c-983e06313da2 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:25.811614 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-254b43ec-d5c0-4c55-9f6c-983e06313da2 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:25.814618 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-254b43ec-d5c0-4c55-9f6c-983e06313da2 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:25.815248 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-254b43ec-d5c0-4c55-9f6c-983e06313da2 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:25.905385 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-789689e7-c4f9-420e-a0cd-d21cd49c4bcc tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:25.914530 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-789689e7-c4f9-420e-a0cd-d21cd49c4bcc tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1322 microversion: 2.1 time: 0.196179 Sep 02 17:09:25.918707 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 67/137] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:25 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:26.021680 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-254b43ec-d5c0-4c55-9f6c-983e06313da2 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:26.030556 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-254b43ec-d5c0-4c55-9f6c-983e06313da2 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:26.032216 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-254b43ec-d5c0-4c55-9f6c-983e06313da2 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:26.033393 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-254b43ec-d5c0-4c55-9f6c-983e06313da2 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1405 microversion: 2.20 time: 0.236107 Sep 02 17:09:26.033944 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 71/138] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:09:25 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1405 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:09:26.229479 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-a7f462d8-45d0-4ccc-973c-628c82ca8433 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:26.230329 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-a7f462d8-45d0-4ccc-973c-628c82ca8433 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:26.237625 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a7f462d8-45d0-4ccc-973c-628c82ca8433 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:26.238077 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a7f462d8-45d0-4ccc-973c-628c82ca8433 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:26.238884 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a7f462d8-45d0-4ccc-973c-628c82ca8433 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:26.239319 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a7f462d8-45d0-4ccc-973c-628c82ca8433 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:26.380129 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-a7f462d8-45d0-4ccc-973c-628c82ca8433 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:26.393489 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-a7f462d8-45d0-4ccc-973c-628c82ca8433 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1363 microversion: 2.1 time: 0.165317 Sep 02 17:09:26.395877 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 68/139] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:26 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:26.449020 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-3a577872-7737-41c7-81f7-706146ca2f25 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:26.449729 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-3a577872-7737-41c7-81f7-706146ca2f25 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:26.455990 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3a577872-7737-41c7-81f7-706146ca2f25 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:26.456437 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3a577872-7737-41c7-81f7-706146ca2f25 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:26.457209 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3a577872-7737-41c7-81f7-706146ca2f25 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:26.457641 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3a577872-7737-41c7-81f7-706146ca2f25 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:26.647570 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-3a577872-7737-41c7-81f7-706146ca2f25 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:26.661422 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-b19d90a2-c240-4511-85db-50c9deaed65d tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:26.661422 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-b19d90a2-c240-4511-85db-50c9deaed65d tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] [instance: 731fe663-d306-40c9-bc5b-af255b67d8d8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:26.677764 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-3a577872-7737-41c7-81f7-706146ca2f25 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97" status: 200 len: 1509 microversion: 2.1 time: 0.232352 Sep 02 17:09:26.678351 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 72/140] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:26 2021] GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 => generated 1509 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:26.699782 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b19d90a2-c240-4511-85db-50c9deaed65d tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:26.702195 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b19d90a2-c240-4511-85db-50c9deaed65d tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:26.704615 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b19d90a2-c240-4511-85db-50c9deaed65d tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:26.705271 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b19d90a2-c240-4511-85db-50c9deaed65d tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:26.870890 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-b19d90a2-c240-4511-85db-50c9deaed65d tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0551e3470b724193ade42d712dfcca04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e70c9c6e0d4dc8ad9911fa97233da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:26.878131 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-b19d90a2-c240-4511-85db-50c9deaed65d tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] 10.222.0.41 "GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8" status: 200 len: 1502 microversion: 2.1 time: 0.241919 Sep 02 17:09:26.878708 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 69/141] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:26 2021] GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8 => generated 1502 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:26.932748 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-82aa0aa8-5788-475b-8f06-4e04e260cf81 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:26.933909 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-82aa0aa8-5788-475b-8f06-4e04e260cf81 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:26.940863 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-82aa0aa8-5788-475b-8f06-4e04e260cf81 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:26.941684 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-82aa0aa8-5788-475b-8f06-4e04e260cf81 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:26.942744 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-82aa0aa8-5788-475b-8f06-4e04e260cf81 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:26.943522 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-82aa0aa8-5788-475b-8f06-4e04e260cf81 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:27.052240 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-61825b61-dd58-444e-ae53-7eb017aea480 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:27.053277 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-61825b61-dd58-444e-ae53-7eb017aea480 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:27.061287 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-61825b61-dd58-444e-ae53-7eb017aea480 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:27.062226 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-61825b61-dd58-444e-ae53-7eb017aea480 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:27.064363 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-61825b61-dd58-444e-ae53-7eb017aea480 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:27.065060 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-61825b61-dd58-444e-ae53-7eb017aea480 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:27.177780 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-82aa0aa8-5788-475b-8f06-4e04e260cf81 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:27.187325 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-82aa0aa8-5788-475b-8f06-4e04e260cf81 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1516 microversion: 2.1 time: 0.258945 Sep 02 17:09:27.200983 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 73/142] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:26 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1516 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:27.208904 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-a534f4cf-2cb8-4a5a-8f57-97561059743e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:27.215954 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-a534f4cf-2cb8-4a5a-8f57-97561059743e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:27.224540 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a534f4cf-2cb8-4a5a-8f57-97561059743e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:27.229979 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a534f4cf-2cb8-4a5a-8f57-97561059743e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:27.236890 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a534f4cf-2cb8-4a5a-8f57-97561059743e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:27.236890 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a534f4cf-2cb8-4a5a-8f57-97561059743e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:27.326382 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-61825b61-dd58-444e-ae53-7eb017aea480 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:27.337842 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-61825b61-dd58-444e-ae53-7eb017aea480 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:27.344428 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-61825b61-dd58-444e-ae53-7eb017aea480 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:27.345916 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-61825b61-dd58-444e-ae53-7eb017aea480 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1405 microversion: 2.20 time: 0.297861 Sep 02 17:09:27.361060 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 70/143] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:09:27 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1405 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:09:27.384912 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.objects.instance [None req-a534f4cf-2cb8-4a5a-8f57-97561059743e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lazy-loading 'flavor' on Instance uuid e8c6e69a-9463-455b-b782-db0bcadacc9e {{(pid=108417) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 17:09:27.411982 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-0cf9c1b7-f357-458c-b33c-eb15abe979f6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:27.412879 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-0cf9c1b7-f357-458c-b33c-eb15abe979f6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:27.427578 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-0cf9c1b7-f357-458c-b33c-eb15abe979f6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:27.428389 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-0cf9c1b7-f357-458c-b33c-eb15abe979f6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:27.429362 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-0cf9c1b7-f357-458c-b33c-eb15abe979f6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:27.429951 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-0cf9c1b7-f357-458c-b33c-eb15abe979f6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:27.567662 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-a534f4cf-2cb8-4a5a-8f57-97561059743e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "POST /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e/action" status: 200 len: 32 microversion: 2.1 time: 0.364563 Sep 02 17:09:27.568918 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 74/144] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:09:27 2021] POST /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e/action => generated 32 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 17:09:27.585398 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-eb7091c1-c99b-48b1-bada-071a6344ae16 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:27.586345 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-eb7091c1-c99b-48b1-bada-071a6344ae16 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:27.618012 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-eb7091c1-c99b-48b1-bada-071a6344ae16 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:27.618853 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-eb7091c1-c99b-48b1-bada-071a6344ae16 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:27.619836 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-eb7091c1-c99b-48b1-bada-071a6344ae16 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:27.620428 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-eb7091c1-c99b-48b1-bada-071a6344ae16 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:27.658036 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-0cf9c1b7-f357-458c-b33c-eb15abe979f6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:27.666750 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-0cf9c1b7-f357-458c-b33c-eb15abe979f6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1363 microversion: 2.1 time: 0.258906 Sep 02 17:09:27.667610 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 71/145] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:27 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:27.771165 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-eb7091c1-c99b-48b1-bada-071a6344ae16 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:27.777225 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-eb7091c1-c99b-48b1-bada-071a6344ae16 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1522 microversion: 2.1 time: 0.197901 Sep 02 17:09:27.778672 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 75/146] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:27 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:28.148830 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-437104c7-c1aa-4c32-91ab-4b15734d3b5a tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d99da6ac-1df8-412b-9d5a-a1fc708e74aa"}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:28.149957 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-437104c7-c1aa-4c32-91ab-4b15734d3b5a tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:28.155999 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-437104c7-c1aa-4c32-91ab-4b15734d3b5a tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:28.156446 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-437104c7-c1aa-4c32-91ab-4b15734d3b5a tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:28.157205 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-437104c7-c1aa-4c32-91ab-4b15734d3b5a tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:28.157650 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-437104c7-c1aa-4c32-91ab-4b15734d3b5a tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:28.366081 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-e260dd1c-8efd-4c1e-8cb5-981ebfe33b25 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:28.366811 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-e260dd1c-8efd-4c1e-8cb5-981ebfe33b25 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:28.388696 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e260dd1c-8efd-4c1e-8cb5-981ebfe33b25 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:28.389152 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e260dd1c-8efd-4c1e-8cb5-981ebfe33b25 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:28.389950 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e260dd1c-8efd-4c1e-8cb5-981ebfe33b25 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:28.390386 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e260dd1c-8efd-4c1e-8cb5-981ebfe33b25 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:28.654754 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-e260dd1c-8efd-4c1e-8cb5-981ebfe33b25 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:28.663457 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-e260dd1c-8efd-4c1e-8cb5-981ebfe33b25 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:28.665514 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-e260dd1c-8efd-4c1e-8cb5-981ebfe33b25 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:28.666616 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-e260dd1c-8efd-4c1e-8cb5-981ebfe33b25 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1405 microversion: 2.20 time: 0.304829 Sep 02 17:09:28.667387 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 76/147] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:09:28 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1405 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:09:28.686964 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-bff0727c-b2f5-4346-8b63-bed9ae1ed81b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:28.687642 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-bff0727c-b2f5-4346-8b63-bed9ae1ed81b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:28.693894 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-bff0727c-b2f5-4346-8b63-bed9ae1ed81b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:28.694542 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-bff0727c-b2f5-4346-8b63-bed9ae1ed81b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:28.694674 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-437104c7-c1aa-4c32-91ab-4b15734d3b5a tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "POST /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.549319 Sep 02 17:09:28.695564 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 72/148] 10.222.0.41 () {60 vars in 1323 bytes} [Thu Sep 2 17:09:28 2021] POST /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97/os-volume_attachments => generated 194 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:09:28.696515 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-bff0727c-b2f5-4346-8b63-bed9ae1ed81b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:28.696956 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-bff0727c-b2f5-4346-8b63-bed9ae1ed81b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:28.794055 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-c6b9c5cb-1530-4aab-a246-ade565b03e52 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:28.794843 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-c6b9c5cb-1530-4aab-a246-ade565b03e52 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:28.803093 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c6b9c5cb-1530-4aab-a246-ade565b03e52 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:28.803838 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c6b9c5cb-1530-4aab-a246-ade565b03e52 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:28.804630 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c6b9c5cb-1530-4aab-a246-ade565b03e52 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:28.805074 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c6b9c5cb-1530-4aab-a246-ade565b03e52 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:28.842275 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-bff0727c-b2f5-4346-8b63-bed9ae1ed81b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:28.849838 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-bff0727c-b2f5-4346-8b63-bed9ae1ed81b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1363 microversion: 2.1 time: 0.168980 Sep 02 17:09:28.850500 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 77/149] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:28 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:28.933727 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-c6b9c5cb-1530-4aab-a246-ade565b03e52 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:28.941157 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-c6b9c5cb-1530-4aab-a246-ade565b03e52 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1522 microversion: 2.1 time: 0.151721 Sep 02 17:09:28.941762 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 73/150] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:28 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:09:29.600345 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-6262abc3-0645-4736-b0cf-07f0497a989d tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "006fb2e2-e19c-4944-9da7-f816ea6ab9e0"}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:29.601448 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-6262abc3-0645-4736-b0cf-07f0497a989d tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] [instance: 731fe663-d306-40c9-bc5b-af255b67d8d8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:29.609225 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6262abc3-0645-4736-b0cf-07f0497a989d tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:29.609225 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6262abc3-0645-4736-b0cf-07f0497a989d tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:29.609225 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6262abc3-0645-4736-b0cf-07f0497a989d tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:29.609225 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6262abc3-0645-4736-b0cf-07f0497a989d tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:29.684677 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-762c615a-0f40-4282-bd68-bada496dff71 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:29.685285 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-762c615a-0f40-4282-bd68-bada496dff71 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:29.691591 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-762c615a-0f40-4282-bd68-bada496dff71 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:29.692037 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-762c615a-0f40-4282-bd68-bada496dff71 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:29.692808 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-762c615a-0f40-4282-bd68-bada496dff71 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:29.693243 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-762c615a-0f40-4282-bd68-bada496dff71 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:29.825429 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-762c615a-0f40-4282-bd68-bada496dff71 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:29.835833 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-762c615a-0f40-4282-bd68-bada496dff71 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:29.837556 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-762c615a-0f40-4282-bd68-bada496dff71 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:29.838872 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-762c615a-0f40-4282-bd68-bada496dff71 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1405 microversion: 2.20 time: 0.157855 Sep 02 17:09:29.839474 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 74/151] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:09:29 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:09:29.869521 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-f0b910f3-e0b8-4d19-ac0e-1474952a058e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:29.872996 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-f0b910f3-e0b8-4d19-ac0e-1474952a058e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:29.879700 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f0b910f3-e0b8-4d19-ac0e-1474952a058e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:29.880389 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f0b910f3-e0b8-4d19-ac0e-1474952a058e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:29.881171 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f0b910f3-e0b8-4d19-ac0e-1474952a058e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:29.881717 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f0b910f3-e0b8-4d19-ac0e-1474952a058e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:30.029858 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-f0b910f3-e0b8-4d19-ac0e-1474952a058e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:30.037238 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-f0b910f3-e0b8-4d19-ac0e-1474952a058e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1363 microversion: 2.1 time: 0.173788 Sep 02 17:09:30.037852 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 75/152] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:29 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:09:30.042370 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-c7bca303-94a1-4bd9-b30a-14ceacb8c3a5 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:30.043296 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-c7bca303-94a1-4bd9-b30a-14ceacb8c3a5 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:30.049393 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c7bca303-94a1-4bd9-b30a-14ceacb8c3a5 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:30.050173 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c7bca303-94a1-4bd9-b30a-14ceacb8c3a5 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:30.050840 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c7bca303-94a1-4bd9-b30a-14ceacb8c3a5 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:30.062169 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c7bca303-94a1-4bd9-b30a-14ceacb8c3a5 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:30.143822 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-6262abc3-0645-4736-b0cf-07f0497a989d tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] 10.222.0.41 "POST /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.547033 Sep 02 17:09:30.144793 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 78/153] 10.222.0.41 () {60 vars in 1323 bytes} [Thu Sep 2 17:09:29 2021] POST /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8/os-volume_attachments => generated 194 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:09:30.226082 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-c7bca303-94a1-4bd9-b30a-14ceacb8c3a5 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:30.233956 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-c7bca303-94a1-4bd9-b30a-14ceacb8c3a5 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1522 microversion: 2.1 time: 0.195123 Sep 02 17:09:30.234530 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 76/154] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:30 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:30.857915 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-f46ddf40-768d-417d-b31b-15e38c116322 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:30.858778 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-f46ddf40-768d-417d-b31b-15e38c116322 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:30.865223 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f46ddf40-768d-417d-b31b-15e38c116322 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:30.865787 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f46ddf40-768d-417d-b31b-15e38c116322 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:30.866684 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f46ddf40-768d-417d-b31b-15e38c116322 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:30.867341 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f46ddf40-768d-417d-b31b-15e38c116322 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:31.042230 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-f46ddf40-768d-417d-b31b-15e38c116322 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:31.055208 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-199a083b-405c-438d-aaff-8ad84f12a759 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:31.056469 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-199a083b-405c-438d-aaff-8ad84f12a759 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:31.066898 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-f46ddf40-768d-417d-b31b-15e38c116322 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:31.067115 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-199a083b-405c-438d-aaff-8ad84f12a759 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:31.067668 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-199a083b-405c-438d-aaff-8ad84f12a759 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:31.069339 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-f46ddf40-768d-417d-b31b-15e38c116322 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:31.070426 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-199a083b-405c-438d-aaff-8ad84f12a759 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:31.072966 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-f46ddf40-768d-417d-b31b-15e38c116322 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1405 microversion: 2.20 time: 0.219211 Sep 02 17:09:31.073187 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-199a083b-405c-438d-aaff-8ad84f12a759 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:31.077982 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 79/155] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:09:30 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1405 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:09:31.169191 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [req-48212bac-3e60-41ca-90be-cb63741b9b55 req-999fec98-7373-44d2-85d0-2a3ae5e689af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e92c68a-a864-4562-b08b-d244394268ce", "name": "network-vif-plugged", "status": "completed", "tag": "0a87c875-7882-47c2-a092-e14ea53f2b64"}]} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:31.171165 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:09:31.171165 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: warnings.warn(msg) Sep 02 17:09:31.179425 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-48212bac-3e60-41ca-90be-cb63741b9b55 req-999fec98-7373-44d2-85d0-2a3ae5e689af service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:31.179981 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-48212bac-3e60-41ca-90be-cb63741b9b55 req-999fec98-7373-44d2-85d0-2a3ae5e689af service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:31.195648 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.compute.server_external_events [req-48212bac-3e60-41ca-90be-cb63741b9b55 req-999fec98-7373-44d2-85d0-2a3ae5e689af service nova] Creating event network-vif-plugged:0a87c875-7882-47c2-a092-e14ea53f2b64 for instance 4e92c68a-a864-4562-b08b-d244394268ce on hv-cinder-80626 Sep 02 17:09:31.201654 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [req-48212bac-3e60-41ca-90be-cb63741b9b55 req-999fec98-7373-44d2-85d0-2a3ae5e689af service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035943 Sep 02 17:09:31.202461 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 80/156] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:09:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:09:31.215180 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-199a083b-405c-438d-aaff-8ad84f12a759 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:31.223895 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-199a083b-405c-438d-aaff-8ad84f12a759 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1363 microversion: 2.1 time: 0.173099 Sep 02 17:09:31.225598 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 77/157] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:31 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:31.257084 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-dd14a511-fc21-4261-9dad-e725b21dbdd2 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:31.257826 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-dd14a511-fc21-4261-9dad-e725b21dbdd2 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:31.268740 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-dd14a511-fc21-4261-9dad-e725b21dbdd2 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:31.269413 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-dd14a511-fc21-4261-9dad-e725b21dbdd2 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:31.270376 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-dd14a511-fc21-4261-9dad-e725b21dbdd2 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:31.271418 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-dd14a511-fc21-4261-9dad-e725b21dbdd2 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:31.466164 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-dd14a511-fc21-4261-9dad-e725b21dbdd2 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:31.475828 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-dd14a511-fc21-4261-9dad-e725b21dbdd2 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1522 microversion: 2.1 time: 0.228436 Sep 02 17:09:31.476783 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 81/158] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:31 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:32.095878 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-8b307ef3-838b-478e-8a7c-8774703ffb89 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:32.096235 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-8b307ef3-838b-478e-8a7c-8774703ffb89 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:32.103248 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8b307ef3-838b-478e-8a7c-8774703ffb89 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:32.103698 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8b307ef3-838b-478e-8a7c-8774703ffb89 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:32.104465 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8b307ef3-838b-478e-8a7c-8774703ffb89 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:32.104896 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8b307ef3-838b-478e-8a7c-8774703ffb89 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:32.228005 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-8b307ef3-838b-478e-8a7c-8774703ffb89 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:32.241073 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-8b307ef3-838b-478e-8a7c-8774703ffb89 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:32.241333 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-d95f8463-dc55-4d46-9c28-75373e32bc54 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:32.242543 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-8b307ef3-838b-478e-8a7c-8774703ffb89 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:32.242724 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-d95f8463-dc55-4d46-9c28-75373e32bc54 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:32.243864 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-8b307ef3-838b-478e-8a7c-8774703ffb89 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1405 microversion: 2.20 time: 0.152396 Sep 02 17:09:32.244528 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 78/159] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:09:32 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:09:32.250407 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d95f8463-dc55-4d46-9c28-75373e32bc54 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:32.250888 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d95f8463-dc55-4d46-9c28-75373e32bc54 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:32.251821 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d95f8463-dc55-4d46-9c28-75373e32bc54 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:32.252282 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d95f8463-dc55-4d46-9c28-75373e32bc54 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:32.396670 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-d95f8463-dc55-4d46-9c28-75373e32bc54 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:32.405392 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-d95f8463-dc55-4d46-9c28-75373e32bc54 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1363 microversion: 2.1 time: 0.167568 Sep 02 17:09:32.410762 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 82/160] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:32 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:32.493107 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-9e9c5ce9-25cc-4735-aa79-bf9f39a4159e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:32.493641 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-9e9c5ce9-25cc-4735-aa79-bf9f39a4159e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:32.499373 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9e9c5ce9-25cc-4735-aa79-bf9f39a4159e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:32.499819 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9e9c5ce9-25cc-4735-aa79-bf9f39a4159e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:32.500578 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9e9c5ce9-25cc-4735-aa79-bf9f39a4159e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:32.501012 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9e9c5ce9-25cc-4735-aa79-bf9f39a4159e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:32.624010 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-9e9c5ce9-25cc-4735-aa79-bf9f39a4159e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:32.631480 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-9e9c5ce9-25cc-4735-aa79-bf9f39a4159e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1522 microversion: 2.1 time: 0.142047 Sep 02 17:09:32.632040 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 79/161] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:32 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1522 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:33.217901 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [req-4d53dae5-2f37-4f41-9357-ea8b19e58a22 req-fc5b08e2-a404-4bba-90e8-5d504eb19b2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77697955-515d-4f49-8b5e-8d01b670ff58", "name": "network-vif-plugged", "status": "completed", "tag": "d6ce6dfa-70c0-4097-860a-9fdc1e531848"}]} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:33.219539 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:09:33.219539 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: warnings.warn(msg) Sep 02 17:09:33.226884 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-4d53dae5-2f37-4f41-9357-ea8b19e58a22 req-fc5b08e2-a404-4bba-90e8-5d504eb19b2a service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:33.227845 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-4d53dae5-2f37-4f41-9357-ea8b19e58a22 req-fc5b08e2-a404-4bba-90e8-5d504eb19b2a service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:33.238877 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.compute.server_external_events [req-4d53dae5-2f37-4f41-9357-ea8b19e58a22 req-fc5b08e2-a404-4bba-90e8-5d504eb19b2a service nova] Creating event network-vif-plugged:d6ce6dfa-70c0-4097-860a-9fdc1e531848 for instance 77697955-515d-4f49-8b5e-8d01b670ff58 on hv-cinder-80626 Sep 02 17:09:33.244568 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [req-4d53dae5-2f37-4f41-9357-ea8b19e58a22 req-fc5b08e2-a404-4bba-90e8-5d504eb19b2a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030070 Sep 02 17:09:33.245324 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 83/162] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:09:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:09:33.261202 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-3f84ec45-549c-4fe8-a013-8cc055eaf8df tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:33.261805 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-3f84ec45-549c-4fe8-a013-8cc055eaf8df tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:33.267604 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3f84ec45-549c-4fe8-a013-8cc055eaf8df tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:33.268050 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3f84ec45-549c-4fe8-a013-8cc055eaf8df tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:33.268850 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3f84ec45-549c-4fe8-a013-8cc055eaf8df tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:33.269234 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3f84ec45-549c-4fe8-a013-8cc055eaf8df tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:33.387991 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-3f84ec45-549c-4fe8-a013-8cc055eaf8df tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:33.395654 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-3f84ec45-549c-4fe8-a013-8cc055eaf8df tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:33.397138 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-3f84ec45-549c-4fe8-a013-8cc055eaf8df tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:33.398235 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-3f84ec45-549c-4fe8-a013-8cc055eaf8df tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1405 microversion: 2.20 time: 0.140747 Sep 02 17:09:33.398810 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 80/163] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:09:33 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1405 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:09:33.429589 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-58dcf7e7-f290-40c1-9487-d0c60261795c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:33.430306 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-58dcf7e7-f290-40c1-9487-d0c60261795c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:33.437368 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-58dcf7e7-f290-40c1-9487-d0c60261795c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:33.437812 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-58dcf7e7-f290-40c1-9487-d0c60261795c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:33.438583 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-58dcf7e7-f290-40c1-9487-d0c60261795c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:33.439035 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-58dcf7e7-f290-40c1-9487-d0c60261795c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:33.559872 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-58dcf7e7-f290-40c1-9487-d0c60261795c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:33.567091 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-58dcf7e7-f290-40c1-9487-d0c60261795c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1363 microversion: 2.1 time: 0.141553 Sep 02 17:09:33.567645 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 84/164] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:33 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1363 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:33.648330 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-8d1562c4-32a0-4f7a-ad64-c14e7243c2b9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:33.648880 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-8d1562c4-32a0-4f7a-ad64-c14e7243c2b9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:33.655150 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8d1562c4-32a0-4f7a-ad64-c14e7243c2b9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:33.655589 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8d1562c4-32a0-4f7a-ad64-c14e7243c2b9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:33.656332 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8d1562c4-32a0-4f7a-ad64-c14e7243c2b9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:33.656760 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8d1562c4-32a0-4f7a-ad64-c14e7243c2b9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:33.773732 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-8d1562c4-32a0-4f7a-ad64-c14e7243c2b9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:33.781951 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-8d1562c4-32a0-4f7a-ad64-c14e7243c2b9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1522 microversion: 2.1 time: 0.137212 Sep 02 17:09:33.782523 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 81/165] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:33 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1522 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:34.415803 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-3a158315-a666-4165-803b-b428519506e0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:34.416541 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-3a158315-a666-4165-803b-b428519506e0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:34.422602 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3a158315-a666-4165-803b-b428519506e0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:34.423068 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3a158315-a666-4165-803b-b428519506e0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:34.423847 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3a158315-a666-4165-803b-b428519506e0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:34.424272 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3a158315-a666-4165-803b-b428519506e0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:34.547939 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-3a158315-a666-4165-803b-b428519506e0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:34.556235 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-3a158315-a666-4165-803b-b428519506e0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:34.557710 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-3a158315-a666-4165-803b-b428519506e0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:34.558832 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-3a158315-a666-4165-803b-b428519506e0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1405 microversion: 2.20 time: 0.147310 Sep 02 17:09:34.559371 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 85/166] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:09:34 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1405 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:09:34.583355 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-ec916444-cb87-4508-9521-134594a08713 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:34.583953 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-ec916444-cb87-4508-9521-134594a08713 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:34.589624 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ec916444-cb87-4508-9521-134594a08713 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:34.590062 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ec916444-cb87-4508-9521-134594a08713 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:34.590842 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ec916444-cb87-4508-9521-134594a08713 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:34.591272 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ec916444-cb87-4508-9521-134594a08713 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:34.711473 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-ec916444-cb87-4508-9521-134594a08713 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:34.718716 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-ec916444-cb87-4508-9521-134594a08713 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1363 microversion: 2.1 time: 0.138999 Sep 02 17:09:34.719275 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 82/167] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:34 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1363 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:34.798910 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-ec2b632a-9396-4f9c-9122-43ef699e69df tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:34.799514 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-ec2b632a-9396-4f9c-9122-43ef699e69df tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:34.806032 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ec2b632a-9396-4f9c-9122-43ef699e69df tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:34.806484 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ec2b632a-9396-4f9c-9122-43ef699e69df tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:34.807275 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ec2b632a-9396-4f9c-9122-43ef699e69df tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:34.807706 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ec2b632a-9396-4f9c-9122-43ef699e69df tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:34.925573 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-ec2b632a-9396-4f9c-9122-43ef699e69df tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:34.933455 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-ec2b632a-9396-4f9c-9122-43ef699e69df tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1522 microversion: 2.1 time: 0.138289 Sep 02 17:09:34.934011 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 86/168] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:34 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1522 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:35.576331 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-2de6568f-8874-43a4-9afc-41b36501a7dd tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:35.576937 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-2de6568f-8874-43a4-9afc-41b36501a7dd tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:35.582730 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2de6568f-8874-43a4-9afc-41b36501a7dd tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:35.583185 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2de6568f-8874-43a4-9afc-41b36501a7dd tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:35.583959 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2de6568f-8874-43a4-9afc-41b36501a7dd tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:35.584508 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2de6568f-8874-43a4-9afc-41b36501a7dd tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:35.712374 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-2de6568f-8874-43a4-9afc-41b36501a7dd tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:35.720230 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-2de6568f-8874-43a4-9afc-41b36501a7dd tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:35.721831 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-2de6568f-8874-43a4-9afc-41b36501a7dd tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:35.722942 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-2de6568f-8874-43a4-9afc-41b36501a7dd tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1405 microversion: 2.20 time: 0.150224 Sep 02 17:09:35.723486 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 83/169] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:09:35 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1405 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:09:35.735822 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-7867b379-b243-4026-a6e5-64421e6f8d96 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:35.736432 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-7867b379-b243-4026-a6e5-64421e6f8d96 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:35.742390 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7867b379-b243-4026-a6e5-64421e6f8d96 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:35.742880 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7867b379-b243-4026-a6e5-64421e6f8d96 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:35.743651 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7867b379-b243-4026-a6e5-64421e6f8d96 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:35.744090 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7867b379-b243-4026-a6e5-64421e6f8d96 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:35.864609 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-7867b379-b243-4026-a6e5-64421e6f8d96 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:35.872264 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-7867b379-b243-4026-a6e5-64421e6f8d96 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1363 microversion: 2.1 time: 0.140408 Sep 02 17:09:35.872818 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 87/170] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:35 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1363 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:35.950745 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-e64a3f90-3399-4234-b82d-4bdfacdfba19 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:35.951285 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-e64a3f90-3399-4234-b82d-4bdfacdfba19 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:35.957072 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e64a3f90-3399-4234-b82d-4bdfacdfba19 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:35.957510 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e64a3f90-3399-4234-b82d-4bdfacdfba19 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:35.958261 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e64a3f90-3399-4234-b82d-4bdfacdfba19 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:35.958714 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e64a3f90-3399-4234-b82d-4bdfacdfba19 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:36.081656 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-e64a3f90-3399-4234-b82d-4bdfacdfba19 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:36.089790 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-e64a3f90-3399-4234-b82d-4bdfacdfba19 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1522 microversion: 2.1 time: 0.143494 Sep 02 17:09:36.091092 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 84/171] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:35 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:36.742041 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-3ea1bb6b-0303-4913-8ae2-1f0dbdf90707 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:36.742780 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-3ea1bb6b-0303-4913-8ae2-1f0dbdf90707 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:36.750545 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3ea1bb6b-0303-4913-8ae2-1f0dbdf90707 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:36.751177 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3ea1bb6b-0303-4913-8ae2-1f0dbdf90707 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:36.752208 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3ea1bb6b-0303-4913-8ae2-1f0dbdf90707 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:36.752641 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3ea1bb6b-0303-4913-8ae2-1f0dbdf90707 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:36.875187 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-3ea1bb6b-0303-4913-8ae2-1f0dbdf90707 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:36.882975 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-3ea1bb6b-0303-4913-8ae2-1f0dbdf90707 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:36.885118 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-3ea1bb6b-0303-4913-8ae2-1f0dbdf90707 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:36.887042 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-3ea1bb6b-0303-4913-8ae2-1f0dbdf90707 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1597 microversion: 2.20 time: 0.149007 Sep 02 17:09:36.887533 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 88/172] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:09:36 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1597 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:09:36.889136 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-e3ad9259-5041-4da6-8bd8-f0cdcffc0a9d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:36.889744 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-e3ad9259-5041-4da6-8bd8-f0cdcffc0a9d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:36.902780 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e3ad9259-5041-4da6-8bd8-f0cdcffc0a9d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:36.903544 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e3ad9259-5041-4da6-8bd8-f0cdcffc0a9d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:36.904789 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e3ad9259-5041-4da6-8bd8-f0cdcffc0a9d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:36.905526 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e3ad9259-5041-4da6-8bd8-f0cdcffc0a9d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:36.906755 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-2a6d2e17-8390-4fac-b6a0-8904a2147f04 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:36.907275 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-2a6d2e17-8390-4fac-b6a0-8904a2147f04 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:36.913575 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2a6d2e17-8390-4fac-b6a0-8904a2147f04 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:36.914017 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2a6d2e17-8390-4fac-b6a0-8904a2147f04 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:36.914884 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2a6d2e17-8390-4fac-b6a0-8904a2147f04 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:36.915312 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2a6d2e17-8390-4fac-b6a0-8904a2147f04 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:37.016296 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-2a6d2e17-8390-4fac-b6a0-8904a2147f04 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.113679 Sep 02 17:09:37.017113 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 89/173] 10.222.0.41 () {60 vars in 1316 bytes} [Thu Sep 2 17:09:36 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:09:37.078502 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-e3ad9259-5041-4da6-8bd8-f0cdcffc0a9d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:37.088950 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-e3ad9259-5041-4da6-8bd8-f0cdcffc0a9d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1363 microversion: 2.1 time: 0.203471 Sep 02 17:09:37.094730 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 85/174] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:36 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:09:37.112397 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-cc2d2941-b9c8-4cbc-a4c1-cbd358c0d494 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:37.112397 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-cc2d2941-b9c8-4cbc-a4c1-cbd358c0d494 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:37.118164 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-cc2d2941-b9c8-4cbc-a4c1-cbd358c0d494 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:37.119263 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-cc2d2941-b9c8-4cbc-a4c1-cbd358c0d494 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:37.120598 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-cc2d2941-b9c8-4cbc-a4c1-cbd358c0d494 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:37.121357 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-cc2d2941-b9c8-4cbc-a4c1-cbd358c0d494 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:37.495976 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-cc2d2941-b9c8-4cbc-a4c1-cbd358c0d494 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:37.505744 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-cc2d2941-b9c8-4cbc-a4c1-cbd358c0d494 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1522 microversion: 2.1 time: 0.402009 Sep 02 17:09:37.506846 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 90/175] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:37 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1522 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:09:38.107352 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-9c526558-6ddf-405a-80fa-2be83bfdd64a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:38.108838 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-9c526558-6ddf-405a-80fa-2be83bfdd64a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:38.115253 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9c526558-6ddf-405a-80fa-2be83bfdd64a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:38.115700 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9c526558-6ddf-405a-80fa-2be83bfdd64a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:38.116546 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9c526558-6ddf-405a-80fa-2be83bfdd64a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:38.117008 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9c526558-6ddf-405a-80fa-2be83bfdd64a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:38.279336 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-9c526558-6ddf-405a-80fa-2be83bfdd64a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:38.286886 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-9c526558-6ddf-405a-80fa-2be83bfdd64a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1549 microversion: 2.1 time: 0.184204 Sep 02 17:09:38.287607 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 86/176] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:38 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1549 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:09:38.304776 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-928e3a1d-5ead-41fe-8b1a-73c87c101e93 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:38.305547 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-928e3a1d-5ead-41fe-8b1a-73c87c101e93 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:38.311619 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-928e3a1d-5ead-41fe-8b1a-73c87c101e93 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:38.312065 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-928e3a1d-5ead-41fe-8b1a-73c87c101e93 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:38.312831 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-928e3a1d-5ead-41fe-8b1a-73c87c101e93 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:38.313272 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-928e3a1d-5ead-41fe-8b1a-73c87c101e93 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:38.462863 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-928e3a1d-5ead-41fe-8b1a-73c87c101e93 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.161006 Sep 02 17:09:38.463745 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 91/177] 10.222.0.41 () {58 vars in 1275 bytes} [Thu Sep 2 17:09:38 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/os-interface => generated 284 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:09:38.523424 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-ac30a830-8791-4204-a9c2-8ec7d7b7a386 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:38.523942 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-ac30a830-8791-4204-a9c2-8ec7d7b7a386 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:38.532243 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ac30a830-8791-4204-a9c2-8ec7d7b7a386 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:38.532692 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ac30a830-8791-4204-a9c2-8ec7d7b7a386 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:38.534492 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ac30a830-8791-4204-a9c2-8ec7d7b7a386 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:38.535296 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ac30a830-8791-4204-a9c2-8ec7d7b7a386 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:38.780101 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-ba8ebace-a3f6-4ae1-8671-5daa550b8517 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:38.781226 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-ba8ebace-a3f6-4ae1-8671-5daa550b8517 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:38.793700 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ba8ebace-a3f6-4ae1-8671-5daa550b8517 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:38.794822 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ba8ebace-a3f6-4ae1-8671-5daa550b8517 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:38.795730 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ba8ebace-a3f6-4ae1-8671-5daa550b8517 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:38.796271 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ba8ebace-a3f6-4ae1-8671-5daa550b8517 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:38.942338 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-ba8ebace-a3f6-4ae1-8671-5daa550b8517 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 14 microversion: 2.20 time: 0.166185 Sep 02 17:09:38.944446 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 92/178] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:09:38 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 14 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:09:38.970616 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-262c0de2-a059-49f7-9e71-8cd43ffc6e7d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-435923659", "imageRef": "22ce6e29-f3a7-49f0-b93a-ddbffa14e44e", "flavorRef": "452", "networks": [{"uuid": "42e64c23-8d50-4a89-acaf-802979ed9882"}]}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:38.970837 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-ac30a830-8791-4204-a9c2-8ec7d7b7a386 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:38.977976 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-ac30a830-8791-4204-a9c2-8ec7d7b7a386 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1522 microversion: 2.1 time: 0.458245 Sep 02 17:09:38.983169 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 87/179] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:38 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1522 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:38.999626 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-4c52bf8a-cdba-432f-a289-ab397f725790 req-803b78fc-871a-4d01-bc66-c48f2e91d361 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e92c68a-a864-4562-b08b-d244394268ce", "tag": "0a87c875-7882-47c2-a092-e14ea53f2b64"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:39.001193 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:09:39.001193 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:09:39.017241 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-4c52bf8a-cdba-432f-a289-ab397f725790 req-803b78fc-871a-4d01-bc66-c48f2e91d361 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:39.017678 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-4c52bf8a-cdba-432f-a289-ab397f725790 req-803b78fc-871a-4d01-bc66-c48f2e91d361 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:39.046007 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-4c52bf8a-cdba-432f-a289-ab397f725790 req-803b78fc-871a-4d01-bc66-c48f2e91d361 service nova] Creating event network-changed:0a87c875-7882-47c2-a092-e14ea53f2b64 for instance 4e92c68a-a864-4562-b08b-d244394268ce on hv-cinder-80626 Sep 02 17:09:39.060261 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-4c52bf8a-cdba-432f-a289-ab397f725790 req-803b78fc-871a-4d01-bc66-c48f2e91d361 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074958 Sep 02 17:09:39.061181 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 88/180] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:09:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:09:39.096612 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.network.neutron [None req-262c0de2-a059-49f7-9e71-8cd43ffc6e7d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] validate_networks() for [('42e64c23-8d50-4a89-acaf-802979ed9882', None, None, None, None, None)] {{(pid=108417) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 17:09:39.943699 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-262c0de2-a059-49f7-9e71-8cd43ffc6e7d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Flavor limits 0:0:0 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 17:09:39.945344 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-262c0de2-a059-49f7-9e71-8cd43ffc6e7d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Image limits 0:0:0 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 17:09:39.946002 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-262c0de2-a059-49f7-9e71-8cd43ffc6e7d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Flavor pref 0:0:0 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 17:09:39.946886 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-262c0de2-a059-49f7-9e71-8cd43ffc6e7d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Image pref 0:0:0 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 17:09:39.947617 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-262c0de2-a059-49f7-9e71-8cd43ffc6e7d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 17:09:39.957345 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-69d2b7a5-10d5-404b-a741-6bca4b67602b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:39.958542 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-69d2b7a5-10d5-404b-a741-6bca4b67602b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:39.965288 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-262c0de2-a059-49f7-9e71-8cd43ffc6e7d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:39.965788 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-262c0de2-a059-49f7-9e71-8cd43ffc6e7d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:39.968913 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-262c0de2-a059-49f7-9e71-8cd43ffc6e7d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:39.970520 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-262c0de2-a059-49f7-9e71-8cd43ffc6e7d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:39.972972 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-69d2b7a5-10d5-404b-a741-6bca4b67602b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:39.974805 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-69d2b7a5-10d5-404b-a741-6bca4b67602b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:39.976072 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-69d2b7a5-10d5-404b-a741-6bca4b67602b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:39.978022 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-69d2b7a5-10d5-404b-a741-6bca4b67602b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:40.018298 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.quota [None req-262c0de2-a059-49f7-9e71-8cd43ffc6e7d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Getting quotas for project 9ec1c77ded4a41158a99f6cf578e395e. Resources: {'instances', 'cores', 'ram'} {{(pid=108417) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 17:09:40.025351 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.quota [None req-262c0de2-a059-49f7-9e71-8cd43ffc6e7d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Getting quotas for user 86d5b6fd03e140b3bfbfef7a087063ec and project 9ec1c77ded4a41158a99f6cf578e395e. Resources: {'instances', 'cores', 'ram'} {{(pid=108417) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 17:09:40.040131 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-262c0de2-a059-49f7-9e71-8cd43ffc6e7d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Going to run 1 instances... {{(pid=108417) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 17:09:40.043899 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-262c0de2-a059-49f7-9e71-8cd43ffc6e7d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 63d568ab-141d-4831-94e8-31e3b983dd4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22ce6e29-f3a7-49f0-b93a-ddbffa14e44e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108417) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 17:09:40.141518 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-69d2b7a5-10d5-404b-a741-6bca4b67602b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 14 microversion: 2.20 time: 0.188511 Sep 02 17:09:40.144558 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 89/181] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:09:39 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 14 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:09:40.146098 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-262c0de2-a059-49f7-9e71-8cd43ffc6e7d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.199880 Sep 02 17:09:40.146764 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 93/182] 10.222.0.41 () {60 vars in 1147 bytes} [Thu Sep 2 17:09:38 2021] POST /compute/v2.1/servers => generated 380 bytes in 1202 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 17:09:40.148947 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-ec2362ed-ded2-41b0-940d-29b340690e68 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:40.149645 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-ec2362ed-ded2-41b0-940d-29b340690e68 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:40.156713 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-ac837870-f25e-481c-a1e0-8b1bcc3dfd21 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:40.157441 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-ac837870-f25e-481c-a1e0-8b1bcc3dfd21 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 63d568ab-141d-4831-94e8-31e3b983dd4a] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:40.176655 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ec2362ed-ded2-41b0-940d-29b340690e68 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:40.177057 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ec2362ed-ded2-41b0-940d-29b340690e68 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:40.181367 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ec2362ed-ded2-41b0-940d-29b340690e68 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:40.181970 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ec2362ed-ded2-41b0-940d-29b340690e68 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:40.322791 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-ac837870-f25e-481c-a1e0-8b1bcc3dfd21 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:40.330567 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-ac837870-f25e-481c-a1e0-8b1bcc3dfd21 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a" status: 200 len: 1217 microversion: 2.1 time: 0.177550 Sep 02 17:09:40.339283 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 94/183] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:40 2021] GET /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a => generated 1217 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:09:40.795418 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-ec2362ed-ded2-41b0-940d-29b340690e68 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:40.802962 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-ec2362ed-ded2-41b0-940d-29b340690e68 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1522 microversion: 2.1 time: 0.659909 Sep 02 17:09:40.805455 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 90/184] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:40 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1522 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:41.157203 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-fa195e5d-56e9-4c35-b439-64153fd97ed6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:41.159765 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-fa195e5d-56e9-4c35-b439-64153fd97ed6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:41.168177 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fa195e5d-56e9-4c35-b439-64153fd97ed6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:41.168824 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fa195e5d-56e9-4c35-b439-64153fd97ed6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:41.169601 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fa195e5d-56e9-4c35-b439-64153fd97ed6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:41.170031 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fa195e5d-56e9-4c35-b439-64153fd97ed6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:41.293492 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-fa195e5d-56e9-4c35-b439-64153fd97ed6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 14 microversion: 2.20 time: 0.144478 Sep 02 17:09:41.294549 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 95/185] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:09:41 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:41.355921 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-d9f817f9-9491-4022-88b3-92ecfaf85830 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:41.357035 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-d9f817f9-9491-4022-88b3-92ecfaf85830 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 63d568ab-141d-4831-94e8-31e3b983dd4a] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:41.365988 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d9f817f9-9491-4022-88b3-92ecfaf85830 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:41.366697 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d9f817f9-9491-4022-88b3-92ecfaf85830 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:41.368243 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d9f817f9-9491-4022-88b3-92ecfaf85830 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:41.368898 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d9f817f9-9491-4022-88b3-92ecfaf85830 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:41.468466 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-d9f817f9-9491-4022-88b3-92ecfaf85830 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:41.475946 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-d9f817f9-9491-4022-88b3-92ecfaf85830 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a" status: 200 len: 1269 microversion: 2.1 time: 0.124502 Sep 02 17:09:41.490334 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-492cbc22-01df-4241-9f9a-90fbf1c4a14e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:41.491357 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-492cbc22-01df-4241-9f9a-90fbf1c4a14e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:41.495239 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 91/186] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:41 2021] GET /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a => generated 1269 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:41.499288 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-492cbc22-01df-4241-9f9a-90fbf1c4a14e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:41.499736 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-492cbc22-01df-4241-9f9a-90fbf1c4a14e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:41.500511 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-492cbc22-01df-4241-9f9a-90fbf1c4a14e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:41.500945 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-492cbc22-01df-4241-9f9a-90fbf1c4a14e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:41.516673 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-fdac2554-86e9-437e-a620-d906d098cb4b req-6a4a488a-f6e1-46ae-a9ec-54eefe7aee5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77697955-515d-4f49-8b5e-8d01b670ff58", "tag": "d6ce6dfa-70c0-4097-860a-9fdc1e531848"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:41.518774 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:09:41.518774 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:09:41.530950 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-fdac2554-86e9-437e-a620-d906d098cb4b req-6a4a488a-f6e1-46ae-a9ec-54eefe7aee5a service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:41.531388 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-fdac2554-86e9-437e-a620-d906d098cb4b req-6a4a488a-f6e1-46ae-a9ec-54eefe7aee5a service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:41.557678 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-fdac2554-86e9-437e-a620-d906d098cb4b req-6a4a488a-f6e1-46ae-a9ec-54eefe7aee5a service nova] Creating event network-changed:d6ce6dfa-70c0-4097-860a-9fdc1e531848 for instance 77697955-515d-4f49-8b5e-8d01b670ff58 on hv-cinder-80626 Sep 02 17:09:41.572885 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-fdac2554-86e9-437e-a620-d906d098cb4b req-6a4a488a-f6e1-46ae-a9ec-54eefe7aee5a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053506 Sep 02 17:09:41.573544 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 92/187] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:09:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:09:41.721059 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-492cbc22-01df-4241-9f9a-90fbf1c4a14e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 14 microversion: 2.1 time: 0.234071 Sep 02 17:09:41.725388 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 96/188] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:09:41 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 14 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 17:09:41.824129 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-3e5b9c21-05b1-4de7-9247-c38be555acca tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:41.825620 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-3e5b9c21-05b1-4de7-9247-c38be555acca tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:41.838726 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3e5b9c21-05b1-4de7-9247-c38be555acca tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:41.839198 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3e5b9c21-05b1-4de7-9247-c38be555acca tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:41.840297 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3e5b9c21-05b1-4de7-9247-c38be555acca tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:41.841762 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3e5b9c21-05b1-4de7-9247-c38be555acca tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:42.307100 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-d02072b2-a96e-4c63-93a1-2723e3e8715c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:42.308781 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-d02072b2-a96e-4c63-93a1-2723e3e8715c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:42.317293 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d02072b2-a96e-4c63-93a1-2723e3e8715c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:42.318502 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d02072b2-a96e-4c63-93a1-2723e3e8715c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:42.319719 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d02072b2-a96e-4c63-93a1-2723e3e8715c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:42.320441 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d02072b2-a96e-4c63-93a1-2723e3e8715c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:42.438756 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-3e5b9c21-05b1-4de7-9247-c38be555acca tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:42.446425 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-3e5b9c21-05b1-4de7-9247-c38be555acca tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1522 microversion: 2.1 time: 0.627634 Sep 02 17:09:42.449472 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 93/189] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:41 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1522 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:42.494934 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-961b12c3-ddb4-4547-a567-2b499a7ca415 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:42.495541 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-961b12c3-ddb4-4547-a567-2b499a7ca415 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 63d568ab-141d-4831-94e8-31e3b983dd4a] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:42.501458 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-961b12c3-ddb4-4547-a567-2b499a7ca415 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:42.501907 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-961b12c3-ddb4-4547-a567-2b499a7ca415 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:42.502727 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-961b12c3-ddb4-4547-a567-2b499a7ca415 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:42.503322 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-961b12c3-ddb4-4547-a567-2b499a7ca415 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:42.591016 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-961b12c3-ddb4-4547-a567-2b499a7ca415 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:42.600678 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-961b12c3-ddb4-4547-a567-2b499a7ca415 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a" status: 200 len: 1275 microversion: 2.1 time: 0.110750 Sep 02 17:09:42.601250 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 94/190] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:42 2021] GET /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a => generated 1275 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:09:42.651025 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-d02072b2-a96e-4c63-93a1-2723e3e8715c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 14 microversion: 2.20 time: 0.349205 Sep 02 17:09:42.652495 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 97/191] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:09:42 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 14 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:42.739279 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-88c07898-f36e-406d-82fd-d38309835b82 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:42.741383 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-88c07898-f36e-406d-82fd-d38309835b82 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:42.757433 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-88c07898-f36e-406d-82fd-d38309835b82 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:42.759713 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-88c07898-f36e-406d-82fd-d38309835b82 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:42.760525 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-88c07898-f36e-406d-82fd-d38309835b82 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:42.760961 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-88c07898-f36e-406d-82fd-d38309835b82 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:42.905588 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-88c07898-f36e-406d-82fd-d38309835b82 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 14 microversion: 2.1 time: 0.176803 Sep 02 17:09:42.906895 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 95/192] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:09:42 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 14 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 17:09:43.475618 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-b8828b6f-cf81-4413-aebd-5c7d425003f8 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:43.478280 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-b8828b6f-cf81-4413-aebd-5c7d425003f8 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:43.486074 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b8828b6f-cf81-4413-aebd-5c7d425003f8 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:43.487077 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b8828b6f-cf81-4413-aebd-5c7d425003f8 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:43.488487 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b8828b6f-cf81-4413-aebd-5c7d425003f8 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:43.489026 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b8828b6f-cf81-4413-aebd-5c7d425003f8 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:43.623734 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-cd411cc6-3637-41bb-aa42-62b4b243e191 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:43.625304 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-cd411cc6-3637-41bb-aa42-62b4b243e191 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 63d568ab-141d-4831-94e8-31e3b983dd4a] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:43.633017 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cd411cc6-3637-41bb-aa42-62b4b243e191 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:43.633905 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cd411cc6-3637-41bb-aa42-62b4b243e191 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:43.635111 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cd411cc6-3637-41bb-aa42-62b4b243e191 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:43.635834 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cd411cc6-3637-41bb-aa42-62b4b243e191 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:43.657555 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-b8828b6f-cf81-4413-aebd-5c7d425003f8 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:43.680765 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-b8828b6f-cf81-4413-aebd-5c7d425003f8 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1522 microversion: 2.1 time: 0.216706 Sep 02 17:09:43.681871 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 98/193] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:43 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:43.690323 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-0671c6ab-225d-428f-8273-320269119781 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:43.691324 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-0671c6ab-225d-428f-8273-320269119781 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:43.706073 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0671c6ab-225d-428f-8273-320269119781 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:43.719058 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0671c6ab-225d-428f-8273-320269119781 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:43.720258 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0671c6ab-225d-428f-8273-320269119781 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:43.721153 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0671c6ab-225d-428f-8273-320269119781 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:43.867035 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-0671c6ab-225d-428f-8273-320269119781 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 14 microversion: 2.20 time: 0.183135 Sep 02 17:09:43.872562 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 99/194] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:09:43 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 14 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:43.875791 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-cd411cc6-3637-41bb-aa42-62b4b243e191 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:43.885809 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-cd411cc6-3637-41bb-aa42-62b4b243e191 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a" status: 200 len: 1317 microversion: 2.1 time: 0.266568 Sep 02 17:09:43.897773 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 96/195] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:43 2021] GET /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a => generated 1317 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:09:43.923037 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-7dee2279-1985-4913-8ffc-2ad2f7ca297c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:43.924752 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-7dee2279-1985-4913-8ffc-2ad2f7ca297c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:43.942180 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7dee2279-1985-4913-8ffc-2ad2f7ca297c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:43.946791 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7dee2279-1985-4913-8ffc-2ad2f7ca297c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:43.947843 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7dee2279-1985-4913-8ffc-2ad2f7ca297c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:43.948295 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7dee2279-1985-4913-8ffc-2ad2f7ca297c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:44.075117 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-7dee2279-1985-4913-8ffc-2ad2f7ca297c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 14 microversion: 2.1 time: 0.158899 Sep 02 17:09:44.078591 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 100/196] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:09:43 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 14 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 17:09:44.698284 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-fb8e7f42-98fd-4da0-a23b-e2bb03d848cb tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:44.698951 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-fb8e7f42-98fd-4da0-a23b-e2bb03d848cb tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:44.712177 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fb8e7f42-98fd-4da0-a23b-e2bb03d848cb tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:44.712822 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fb8e7f42-98fd-4da0-a23b-e2bb03d848cb tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:44.713608 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fb8e7f42-98fd-4da0-a23b-e2bb03d848cb tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:44.714043 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fb8e7f42-98fd-4da0-a23b-e2bb03d848cb tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:44.885509 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [req-ae1ae7bd-9c1b-426a-9212-2f1c512e9835 req-e736dbfc-c4a8-4915-9aff-2784a445a94d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63d568ab-141d-4831-94e8-31e3b983dd4a", "tag": "3e150f1a-44ff-4964-8378-9720427117af"}]} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:44.895289 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:09:44.895289 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: warnings.warn(msg) Sep 02 17:09:44.937806 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-ae1ae7bd-9c1b-426a-9212-2f1c512e9835 req-e736dbfc-c4a8-4915-9aff-2784a445a94d service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:44.938299 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-ae1ae7bd-9c1b-426a-9212-2f1c512e9835 req-e736dbfc-c4a8-4915-9aff-2784a445a94d service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:44.978526 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.compute.server_external_events [req-ae1ae7bd-9c1b-426a-9212-2f1c512e9835 req-e736dbfc-c4a8-4915-9aff-2784a445a94d service nova] Creating event network-changed:3e150f1a-44ff-4964-8378-9720427117af for instance 63d568ab-141d-4831-94e8-31e3b983dd4a on hv-cinder-80626 Sep 02 17:09:44.989200 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [req-ae1ae7bd-9c1b-426a-9212-2f1c512e9835 req-e736dbfc-c4a8-4915-9aff-2784a445a94d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111959 Sep 02 17:09:44.990816 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 101/197] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:09:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:09:45.010549 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-855a75cb-f09a-4fd7-b80f-6d784e4700dc tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:45.012142 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-855a75cb-f09a-4fd7-b80f-6d784e4700dc tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:45.021196 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-fb8e7f42-98fd-4da0-a23b-e2bb03d848cb tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:45.021584 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-855a75cb-f09a-4fd7-b80f-6d784e4700dc tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:45.022346 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-855a75cb-f09a-4fd7-b80f-6d784e4700dc tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:45.023794 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-855a75cb-f09a-4fd7-b80f-6d784e4700dc tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:45.025011 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-855a75cb-f09a-4fd7-b80f-6d784e4700dc tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:45.031670 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-fb8e7f42-98fd-4da0-a23b-e2bb03d848cb tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1522 microversion: 2.1 time: 0.338041 Sep 02 17:09:45.034024 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 97/198] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:44 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1522 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:09:45.050287 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-6fc82d1c-0e65-45fa-9e83-5d7201f252e4 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:45.052776 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-6fc82d1c-0e65-45fa-9e83-5d7201f252e4 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 63d568ab-141d-4831-94e8-31e3b983dd4a] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:45.065522 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6fc82d1c-0e65-45fa-9e83-5d7201f252e4 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:45.067030 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6fc82d1c-0e65-45fa-9e83-5d7201f252e4 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:45.069211 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6fc82d1c-0e65-45fa-9e83-5d7201f252e4 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:45.070561 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6fc82d1c-0e65-45fa-9e83-5d7201f252e4 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:45.207060 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-855a75cb-f09a-4fd7-b80f-6d784e4700dc tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 14 microversion: 2.20 time: 0.213928 Sep 02 17:09:45.207996 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 102/199] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:09:44 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 14 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:45.216751 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-2c81eebe-950a-432a-8fe2-50225a4c7bd2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:45.219013 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-2c81eebe-950a-432a-8fe2-50225a4c7bd2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:45.238779 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2c81eebe-950a-432a-8fe2-50225a4c7bd2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:45.239509 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2c81eebe-950a-432a-8fe2-50225a4c7bd2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:45.240172 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2c81eebe-950a-432a-8fe2-50225a4c7bd2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:45.240606 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2c81eebe-950a-432a-8fe2-50225a4c7bd2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:45.396840 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-2c81eebe-950a-432a-8fe2-50225a4c7bd2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 14 microversion: 2.1 time: 0.186522 Sep 02 17:09:45.399060 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 103/200] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:09:45 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 14 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 17:09:45.632889 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-6fc82d1c-0e65-45fa-9e83-5d7201f252e4 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:45.654545 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-6fc82d1c-0e65-45fa-9e83-5d7201f252e4 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a" status: 200 len: 1317 microversion: 2.1 time: 0.616536 Sep 02 17:09:45.655558 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 98/201] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:45 2021] GET /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a => generated 1317 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:46.053055 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-ab773b75-3845-4332-97f4-467abf428014 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:46.053807 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-ab773b75-3845-4332-97f4-467abf428014 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:46.065320 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ab773b75-3845-4332-97f4-467abf428014 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:46.066561 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ab773b75-3845-4332-97f4-467abf428014 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:46.068092 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ab773b75-3845-4332-97f4-467abf428014 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:46.069131 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ab773b75-3845-4332-97f4-467abf428014 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:46.218112 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-b6523959-1854-4548-b677-8825c652de6e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:46.219823 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-b6523959-1854-4548-b677-8825c652de6e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:46.232610 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b6523959-1854-4548-b677-8825c652de6e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:46.233645 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b6523959-1854-4548-b677-8825c652de6e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:46.242222 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b6523959-1854-4548-b677-8825c652de6e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:46.244498 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b6523959-1854-4548-b677-8825c652de6e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:46.295791 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-ab773b75-3845-4332-97f4-467abf428014 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:46.302958 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-ab773b75-3845-4332-97f4-467abf428014 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1522 microversion: 2.1 time: 0.255199 Sep 02 17:09:46.311013 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 104/202] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:46 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:46.365279 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-b6523959-1854-4548-b677-8825c652de6e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 14 microversion: 2.20 time: 0.151013 Sep 02 17:09:46.366224 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 99/203] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:09:46 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 14 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:46.409741 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-93fa4090-576f-46c1-8fc2-d3689732c4eb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:46.411386 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-93fa4090-576f-46c1-8fc2-d3689732c4eb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:46.422512 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-93fa4090-576f-46c1-8fc2-d3689732c4eb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:46.425198 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-93fa4090-576f-46c1-8fc2-d3689732c4eb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:46.426067 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-93fa4090-576f-46c1-8fc2-d3689732c4eb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:46.426542 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-93fa4090-576f-46c1-8fc2-d3689732c4eb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:46.574279 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-93fa4090-576f-46c1-8fc2-d3689732c4eb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 14 microversion: 2.1 time: 0.169621 Sep 02 17:09:46.575277 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 105/204] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:09:46 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 14 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 17:09:46.615147 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-29a52ded-d9c3-4a4c-9e04-c03c4823d38f tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:46.615845 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-29a52ded-d9c3-4a4c-9e04-c03c4823d38f tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] [instance: 731fe663-d306-40c9-bc5b-af255b67d8d8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:46.623309 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-29a52ded-d9c3-4a4c-9e04-c03c4823d38f tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:46.623938 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-29a52ded-d9c3-4a4c-9e04-c03c4823d38f tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:46.624786 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-29a52ded-d9c3-4a4c-9e04-c03c4823d38f tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:46.625288 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-29a52ded-d9c3-4a4c-9e04-c03c4823d38f tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:46.675160 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-f4453c9d-c321-4314-a99c-be2ae542d7bc tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:46.676733 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-f4453c9d-c321-4314-a99c-be2ae542d7bc tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 63d568ab-141d-4831-94e8-31e3b983dd4a] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:46.687910 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-29a52ded-d9c3-4a4c-9e04-c03c4823d38f tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] [instance: 731fe663-d306-40c9-bc5b-af255b67d8d8] Going to try to terminate instance {{(pid=108418) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 17:09:46.690058 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f4453c9d-c321-4314-a99c-be2ae542d7bc tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:46.690867 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f4453c9d-c321-4314-a99c-be2ae542d7bc tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:46.692029 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f4453c9d-c321-4314-a99c-be2ae542d7bc tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:46.692654 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f4453c9d-c321-4314-a99c-be2ae542d7bc tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:46.889744 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-29a52ded-d9c3-4a4c-9e04-c03c4823d38f tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] 10.222.0.41 "DELETE /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8" status: 204 len: 0 microversion: 2.1 time: 0.278286 Sep 02 17:09:46.890338 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 100/205] 10.222.0.41 () {58 vars in 1239 bytes} [Thu Sep 2 17:09:46 2021] DELETE /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 17:09:46.913062 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-5dde66da-cfdf-45d4-a3c6-b20f789a9335 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:46.914136 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-5dde66da-cfdf-45d4-a3c6-b20f789a9335 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] [instance: 731fe663-d306-40c9-bc5b-af255b67d8d8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:46.925485 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5dde66da-cfdf-45d4-a3c6-b20f789a9335 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:46.926998 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5dde66da-cfdf-45d4-a3c6-b20f789a9335 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:46.929041 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5dde66da-cfdf-45d4-a3c6-b20f789a9335 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:46.929742 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5dde66da-cfdf-45d4-a3c6-b20f789a9335 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:46.942196 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-f4453c9d-c321-4314-a99c-be2ae542d7bc tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:46.969179 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-f4453c9d-c321-4314-a99c-be2ae542d7bc tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a" status: 200 len: 1317 microversion: 2.1 time: 0.301895 Sep 02 17:09:46.969766 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 106/206] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:46 2021] GET /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:09:47.137314 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-5dde66da-cfdf-45d4-a3c6-b20f789a9335 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0551e3470b724193ade42d712dfcca04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e70c9c6e0d4dc8ad9911fa97233da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:47.146390 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-5dde66da-cfdf-45d4-a3c6-b20f789a9335 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] 10.222.0.41 "GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8" status: 200 len: 1554 microversion: 2.1 time: 0.251447 Sep 02 17:09:47.147227 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 101/207] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:46 2021] GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8 => generated 1554 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:47.319687 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-e1ff5956-f288-47bc-beaf-071eec91f428 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:47.320301 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-e1ff5956-f288-47bc-beaf-071eec91f428 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:47.328190 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e1ff5956-f288-47bc-beaf-071eec91f428 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:47.329244 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e1ff5956-f288-47bc-beaf-071eec91f428 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:47.330365 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e1ff5956-f288-47bc-beaf-071eec91f428 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:47.331352 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e1ff5956-f288-47bc-beaf-071eec91f428 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:47.376329 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-cfbaf955-b667-4b2d-845c-5366201554c0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:47.377379 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-cfbaf955-b667-4b2d-845c-5366201554c0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:47.384304 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cfbaf955-b667-4b2d-845c-5366201554c0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:47.389229 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cfbaf955-b667-4b2d-845c-5366201554c0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:47.390297 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cfbaf955-b667-4b2d-845c-5366201554c0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:47.390970 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cfbaf955-b667-4b2d-845c-5366201554c0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:47.548646 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-cfbaf955-b667-4b2d-845c-5366201554c0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 14 microversion: 2.20 time: 0.174972 Sep 02 17:09:47.549707 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 102/208] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:09:47 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 14 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:09:47.549999 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-e1ff5956-f288-47bc-beaf-071eec91f428 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:47.559766 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-e1ff5956-f288-47bc-beaf-071eec91f428 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1522 microversion: 2.1 time: 0.243665 Sep 02 17:09:47.569940 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 107/209] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:47 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:47.587623 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-d393f44f-dde3-4625-ae05-c705d7e7bbc2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:47.595129 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-d393f44f-dde3-4625-ae05-c705d7e7bbc2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:47.601267 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d393f44f-dde3-4625-ae05-c705d7e7bbc2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:47.603326 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d393f44f-dde3-4625-ae05-c705d7e7bbc2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:47.604351 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d393f44f-dde3-4625-ae05-c705d7e7bbc2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:47.605688 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d393f44f-dde3-4625-ae05-c705d7e7bbc2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:47.769107 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-d393f44f-dde3-4625-ae05-c705d7e7bbc2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 14 microversion: 2.1 time: 0.186098 Sep 02 17:09:47.769849 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 103/210] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:09:47 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 14 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 17:09:47.988858 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-18829405-4ae9-498a-a7f3-0f9200f92487 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:47.989782 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-18829405-4ae9-498a-a7f3-0f9200f92487 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 63d568ab-141d-4831-94e8-31e3b983dd4a] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:48.007953 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-18829405-4ae9-498a-a7f3-0f9200f92487 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:48.014328 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-18829405-4ae9-498a-a7f3-0f9200f92487 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:48.015546 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-18829405-4ae9-498a-a7f3-0f9200f92487 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:48.016235 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-18829405-4ae9-498a-a7f3-0f9200f92487 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:48.165839 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-05641cb6-2ca9-4e76-a1ad-e86a84aaef42 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:48.166720 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-05641cb6-2ca9-4e76-a1ad-e86a84aaef42 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] [instance: 731fe663-d306-40c9-bc5b-af255b67d8d8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:48.173847 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-18829405-4ae9-498a-a7f3-0f9200f92487 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:48.175861 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-05641cb6-2ca9-4e76-a1ad-e86a84aaef42 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:48.178454 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-05641cb6-2ca9-4e76-a1ad-e86a84aaef42 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:48.179412 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-05641cb6-2ca9-4e76-a1ad-e86a84aaef42 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:48.181975 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-18829405-4ae9-498a-a7f3-0f9200f92487 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a" status: 200 len: 1317 microversion: 2.1 time: 0.197797 Sep 02 17:09:48.182617 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-05641cb6-2ca9-4e76-a1ad-e86a84aaef42 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:48.183079 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 108/211] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:47 2021] GET /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a => generated 1317 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:48.390169 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-05641cb6-2ca9-4e76-a1ad-e86a84aaef42 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0551e3470b724193ade42d712dfcca04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e70c9c6e0d4dc8ad9911fa97233da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:48.401389 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-05641cb6-2ca9-4e76-a1ad-e86a84aaef42 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] 10.222.0.41 "GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8" status: 200 len: 1554 microversion: 2.1 time: 0.240566 Sep 02 17:09:48.402203 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 104/212] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:48 2021] GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8 => generated 1554 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:09:48.559847 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-b753500b-3601-4ed5-b750-92b0301a0ca7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:48.560691 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-b753500b-3601-4ed5-b750-92b0301a0ca7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:48.568968 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b753500b-3601-4ed5-b750-92b0301a0ca7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:48.569419 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b753500b-3601-4ed5-b750-92b0301a0ca7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:48.570202 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b753500b-3601-4ed5-b750-92b0301a0ca7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:48.577939 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-53976417-d431-480f-82ed-e4c38ef87342 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:48.578773 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-53976417-d431-480f-82ed-e4c38ef87342 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:48.583936 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b753500b-3601-4ed5-b750-92b0301a0ca7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:48.589982 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-53976417-d431-480f-82ed-e4c38ef87342 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:48.590437 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-53976417-d431-480f-82ed-e4c38ef87342 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:48.591253 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-53976417-d431-480f-82ed-e4c38ef87342 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:48.591690 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-53976417-d431-480f-82ed-e4c38ef87342 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:48.719857 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-b753500b-3601-4ed5-b750-92b0301a0ca7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 14 microversion: 2.20 time: 0.164284 Sep 02 17:09:48.720979 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 109/213] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:09:48 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 14 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:48.786854 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-c5cc35cc-74ab-4564-9b4a-ce460006df35 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:48.787365 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-53976417-d431-480f-82ed-e4c38ef87342 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:48.787975 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-c5cc35cc-74ab-4564-9b4a-ce460006df35 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:48.795455 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c5cc35cc-74ab-4564-9b4a-ce460006df35 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:48.796397 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c5cc35cc-74ab-4564-9b4a-ce460006df35 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:48.796771 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-53976417-d431-480f-82ed-e4c38ef87342 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1522 microversion: 2.1 time: 0.222632 Sep 02 17:09:48.797240 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c5cc35cc-74ab-4564-9b4a-ce460006df35 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:48.797665 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c5cc35cc-74ab-4564-9b4a-ce460006df35 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:48.799698 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 105/214] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:48 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:48.918547 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-c5cc35cc-74ab-4564-9b4a-ce460006df35 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 14 microversion: 2.1 time: 0.140775 Sep 02 17:09:48.919204 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 110/215] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:09:48 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 14 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 02 17:09:49.203204 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-7cb968a9-e840-4e0d-acd5-1bbcc8faa6cf tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:49.205059 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-7cb968a9-e840-4e0d-acd5-1bbcc8faa6cf tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 63d568ab-141d-4831-94e8-31e3b983dd4a] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:49.218553 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7cb968a9-e840-4e0d-acd5-1bbcc8faa6cf tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:49.219769 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7cb968a9-e840-4e0d-acd5-1bbcc8faa6cf tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:49.221226 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7cb968a9-e840-4e0d-acd5-1bbcc8faa6cf tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:49.223783 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7cb968a9-e840-4e0d-acd5-1bbcc8faa6cf tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:49.422115 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-8a4ca4f7-6021-47f8-bcb3-3cbd83ead0a5 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:49.424772 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-8a4ca4f7-6021-47f8-bcb3-3cbd83ead0a5 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] [instance: 731fe663-d306-40c9-bc5b-af255b67d8d8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:49.432085 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8a4ca4f7-6021-47f8-bcb3-3cbd83ead0a5 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:49.432648 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8a4ca4f7-6021-47f8-bcb3-3cbd83ead0a5 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:49.433708 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8a4ca4f7-6021-47f8-bcb3-3cbd83ead0a5 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:49.434138 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8a4ca4f7-6021-47f8-bcb3-3cbd83ead0a5 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:49.456808 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-7cb968a9-e840-4e0d-acd5-1bbcc8faa6cf tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:49.465586 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-7cb968a9-e840-4e0d-acd5-1bbcc8faa6cf tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a" status: 200 len: 1317 microversion: 2.1 time: 0.269844 Sep 02 17:09:49.466608 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 106/216] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:49 2021] GET /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a => generated 1317 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:49.645161 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-8a4ca4f7-6021-47f8-bcb3-3cbd83ead0a5 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0551e3470b724193ade42d712dfcca04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e70c9c6e0d4dc8ad9911fa97233da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:49.657254 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-8a4ca4f7-6021-47f8-bcb3-3cbd83ead0a5 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] 10.222.0.41 "GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8" status: 200 len: 1554 microversion: 2.1 time: 0.240788 Sep 02 17:09:49.669303 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 111/217] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:49 2021] GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8 => generated 1554 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:49.733945 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-772d85ea-bc8f-4b3d-bbea-f883d0a51dd6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:49.736148 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-772d85ea-bc8f-4b3d-bbea-f883d0a51dd6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:49.746346 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-772d85ea-bc8f-4b3d-bbea-f883d0a51dd6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:49.746892 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-772d85ea-bc8f-4b3d-bbea-f883d0a51dd6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:49.748636 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-772d85ea-bc8f-4b3d-bbea-f883d0a51dd6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:49.750905 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-772d85ea-bc8f-4b3d-bbea-f883d0a51dd6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:49.816290 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-149f7b0f-c8d3-4f45-bb54-89ddb2c84623 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:49.816881 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-149f7b0f-c8d3-4f45-bb54-89ddb2c84623 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:49.823455 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-149f7b0f-c8d3-4f45-bb54-89ddb2c84623 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:49.824189 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-149f7b0f-c8d3-4f45-bb54-89ddb2c84623 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:49.825133 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-149f7b0f-c8d3-4f45-bb54-89ddb2c84623 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:49.825735 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-149f7b0f-c8d3-4f45-bb54-89ddb2c84623 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:49.946297 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-772d85ea-bc8f-4b3d-bbea-f883d0a51dd6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 14 microversion: 2.20 time: 0.217579 Sep 02 17:09:49.946959 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 107/218] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:09:49 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 14 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:09:49.953393 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-21e0d4dc-cb5e-402e-a672-590554f5f71d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:49.957667 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-21e0d4dc-cb5e-402e-a672-590554f5f71d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:49.970190 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-21e0d4dc-cb5e-402e-a672-590554f5f71d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:49.973616 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-21e0d4dc-cb5e-402e-a672-590554f5f71d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:49.974570 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-21e0d4dc-cb5e-402e-a672-590554f5f71d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:49.975537 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-21e0d4dc-cb5e-402e-a672-590554f5f71d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:50.026325 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-149f7b0f-c8d3-4f45-bb54-89ddb2c84623 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:50.034022 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-149f7b0f-c8d3-4f45-bb54-89ddb2c84623 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1522 microversion: 2.1 time: 0.221399 Sep 02 17:09:50.039637 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 112/219] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:49 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:50.179450 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-21e0d4dc-cb5e-402e-a672-590554f5f71d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 14 microversion: 2.1 time: 0.230416 Sep 02 17:09:50.180159 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 108/220] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:09:49 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 14 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 17:09:50.482437 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-59239c3d-ad46-4c00-8154-ceb39bdbbbfb tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:50.483166 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-59239c3d-ad46-4c00-8154-ceb39bdbbbfb tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 63d568ab-141d-4831-94e8-31e3b983dd4a] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:50.489950 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-59239c3d-ad46-4c00-8154-ceb39bdbbbfb tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:50.490567 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-59239c3d-ad46-4c00-8154-ceb39bdbbbfb tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:50.494151 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-59239c3d-ad46-4c00-8154-ceb39bdbbbfb tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:50.494609 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-59239c3d-ad46-4c00-8154-ceb39bdbbbfb tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:50.641544 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-59239c3d-ad46-4c00-8154-ceb39bdbbbfb tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:50.649737 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-59239c3d-ad46-4c00-8154-ceb39bdbbbfb tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a" status: 200 len: 1317 microversion: 2.1 time: 0.170388 Sep 02 17:09:50.655062 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 113/221] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:50 2021] GET /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:50.678107 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-1b27f7f9-bd36-46e2-a774-c58e72d6f727 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:50.679477 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-1b27f7f9-bd36-46e2-a774-c58e72d6f727 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] [instance: 731fe663-d306-40c9-bc5b-af255b67d8d8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:50.686432 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1b27f7f9-bd36-46e2-a774-c58e72d6f727 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:50.687157 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1b27f7f9-bd36-46e2-a774-c58e72d6f727 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:50.688068 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1b27f7f9-bd36-46e2-a774-c58e72d6f727 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:50.695289 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1b27f7f9-bd36-46e2-a774-c58e72d6f727 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:50.917731 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-1b27f7f9-bd36-46e2-a774-c58e72d6f727 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0551e3470b724193ade42d712dfcca04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e70c9c6e0d4dc8ad9911fa97233da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:50.926909 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-1b27f7f9-bd36-46e2-a774-c58e72d6f727 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] 10.222.0.41 "GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8" status: 200 len: 1554 microversion: 2.1 time: 0.253638 Sep 02 17:09:50.927752 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 109/222] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:50 2021] GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8 => generated 1554 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:09:50.957730 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-98dc349a-a2ec-46f2-9738-af8de7022de1 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:50.959047 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-98dc349a-a2ec-46f2-9738-af8de7022de1 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:50.965295 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-98dc349a-a2ec-46f2-9738-af8de7022de1 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:50.965760 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-98dc349a-a2ec-46f2-9738-af8de7022de1 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:50.966683 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-98dc349a-a2ec-46f2-9738-af8de7022de1 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:50.967070 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-98dc349a-a2ec-46f2-9738-af8de7022de1 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:51.060431 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-e520fe03-515d-4b62-81c5-4ef8df351ea7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:51.061347 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-e520fe03-515d-4b62-81c5-4ef8df351ea7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:51.067417 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e520fe03-515d-4b62-81c5-4ef8df351ea7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:51.067864 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e520fe03-515d-4b62-81c5-4ef8df351ea7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:51.068638 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e520fe03-515d-4b62-81c5-4ef8df351ea7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:51.069243 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e520fe03-515d-4b62-81c5-4ef8df351ea7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:51.132295 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-98dc349a-a2ec-46f2-9738-af8de7022de1 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 14 microversion: 2.20 time: 0.178083 Sep 02 17:09:51.133802 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 114/223] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:09:50 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 14 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:51.190072 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-1701193a-3b5b-4526-8d3d-02f0a883fa9f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:51.191132 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-1701193a-3b5b-4526-8d3d-02f0a883fa9f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:51.197597 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1701193a-3b5b-4526-8d3d-02f0a883fa9f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:51.198281 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1701193a-3b5b-4526-8d3d-02f0a883fa9f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:51.199432 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1701193a-3b5b-4526-8d3d-02f0a883fa9f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:51.200070 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1701193a-3b5b-4526-8d3d-02f0a883fa9f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:51.322739 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-1701193a-3b5b-4526-8d3d-02f0a883fa9f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 14 microversion: 2.1 time: 0.136410 Sep 02 17:09:51.322917 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-e520fe03-515d-4b62-81c5-4ef8df351ea7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:51.323524 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 115/224] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:09:51 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 17:09:51.328223 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [req-21bfddf0-5e40-4649-b4e7-8c7610fb71bd req-47746bdb-126b-4cfc-a493-81b010029513 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "731fe663-d306-40c9-bc5b-af255b67d8d8", "name": "network-vif-deleted", "tag": "84985843-a05d-4eec-a8e6-63d146fd1bf1"}]} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:51.329681 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:09:51.329681 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: warnings.warn(msg) Sep 02 17:09:51.336822 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-e520fe03-515d-4b62-81c5-4ef8df351ea7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1522 microversion: 2.1 time: 0.280462 Sep 02 17:09:51.342898 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 110/225] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:51 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:51.343069 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-21bfddf0-5e40-4649-b4e7-8c7610fb71bd req-47746bdb-126b-4cfc-a493-81b010029513 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:51.343069 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-21bfddf0-5e40-4649-b4e7-8c7610fb71bd req-47746bdb-126b-4cfc-a493-81b010029513 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:51.351104 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.compute.server_external_events [req-21bfddf0-5e40-4649-b4e7-8c7610fb71bd req-47746bdb-126b-4cfc-a493-81b010029513 service nova] Creating event network-vif-deleted:84985843-a05d-4eec-a8e6-63d146fd1bf1 for instance 731fe663-d306-40c9-bc5b-af255b67d8d8 on hv-cinder-80626 Sep 02 17:09:51.356354 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [req-21bfddf0-5e40-4649-b4e7-8c7610fb71bd req-47746bdb-126b-4cfc-a493-81b010029513 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031741 Sep 02 17:09:51.357105 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 116/226] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:09:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:09:51.526251 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-2cf0553b-b1a0-482f-9ada-b145c3844e8e tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1213010089", "imageRef": "22ce6e29-f3a7-49f0-b93a-ddbffa14e44e", "flavorRef": "452", "networks": [{"uuid": "66d8eb5c-183b-4388-baa3-2c614c901226"}]}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:51.578458 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.network.neutron [None req-2cf0553b-b1a0-482f-9ada-b145c3844e8e tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] validate_networks() for [('66d8eb5c-183b-4388-baa3-2c614c901226', None, None, None, None, None)] {{(pid=108418) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 17:09:51.671311 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-9d823db5-2481-46a4-8e2a-98c6431d7f0d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:51.671944 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-9d823db5-2481-46a4-8e2a-98c6431d7f0d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 63d568ab-141d-4831-94e8-31e3b983dd4a] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:51.678116 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9d823db5-2481-46a4-8e2a-98c6431d7f0d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:51.679082 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9d823db5-2481-46a4-8e2a-98c6431d7f0d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:51.680680 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9d823db5-2481-46a4-8e2a-98c6431d7f0d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:51.681126 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9d823db5-2481-46a4-8e2a-98c6431d7f0d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:51.821592 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-9d823db5-2481-46a4-8e2a-98c6431d7f0d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:51.828839 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-9d823db5-2481-46a4-8e2a-98c6431d7f0d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a" status: 200 len: 1317 microversion: 2.1 time: 0.161724 Sep 02 17:09:51.829386 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 117/227] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:51 2021] GET /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:09:51.944639 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-7da91a3b-ea9f-49be-85de-dbadf84afd16 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:51.945366 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-7da91a3b-ea9f-49be-85de-dbadf84afd16 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] [instance: 731fe663-d306-40c9-bc5b-af255b67d8d8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:51.951824 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7da91a3b-ea9f-49be-85de-dbadf84afd16 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:51.952411 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7da91a3b-ea9f-49be-85de-dbadf84afd16 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:51.953301 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7da91a3b-ea9f-49be-85de-dbadf84afd16 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:51.953857 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7da91a3b-ea9f-49be-85de-dbadf84afd16 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:51.998354 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7da91a3b-ea9f-49be-85de-dbadf84afd16 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:51.999023 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7da91a3b-ea9f-49be-85de-dbadf84afd16 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:51.999492 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.objects.instance [None req-7da91a3b-ea9f-49be-85de-dbadf84afd16 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lazy-loading 'fault' on Instance uuid 731fe663-d306-40c9-bc5b-af255b67d8d8 {{(pid=108417) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 17:09:52.036327 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-2cf0553b-b1a0-482f-9ada-b145c3844e8e tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Flavor limits 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 17:09:52.041244 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-2cf0553b-b1a0-482f-9ada-b145c3844e8e tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Image limits 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 17:09:52.043029 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-2cf0553b-b1a0-482f-9ada-b145c3844e8e tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Flavor pref 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 17:09:52.044250 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-2cf0553b-b1a0-482f-9ada-b145c3844e8e tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Image pref 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 17:09:52.045236 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-2cf0553b-b1a0-482f-9ada-b145c3844e8e tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 17:09:52.049542 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-7da91a3b-ea9f-49be-85de-dbadf84afd16 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0551e3470b724193ade42d712dfcca04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39e70c9c6e0d4dc8ad9911fa97233da1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:52.061641 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2cf0553b-b1a0-482f-9ada-b145c3844e8e tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:52.062498 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2cf0553b-b1a0-482f-9ada-b145c3844e8e tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:52.062642 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-7da91a3b-ea9f-49be-85de-dbadf84afd16 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] 10.222.0.41 "GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8" status: 200 len: 1351 microversion: 2.1 time: 0.121534 Sep 02 17:09:52.063726 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2cf0553b-b1a0-482f-9ada-b145c3844e8e tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:52.064329 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2cf0553b-b1a0-482f-9ada-b145c3844e8e tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:52.064835 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 118/228] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:51 2021] GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8 => generated 1351 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:09:52.083294 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.quota [None req-2cf0553b-b1a0-482f-9ada-b145c3844e8e tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Getting quotas for project 8b68171454c54ab49ec2f23eb7573aa8. Resources: {'instances', 'cores', 'ram'} {{(pid=108418) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 17:09:52.087737 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.quota [None req-2cf0553b-b1a0-482f-9ada-b145c3844e8e tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Getting quotas for user 45335dcd625c4b819d42cacea1aaf946 and project 8b68171454c54ab49ec2f23eb7573aa8. Resources: {'instances', 'cores', 'ram'} {{(pid=108418) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 17:09:52.098494 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-2cf0553b-b1a0-482f-9ada-b145c3844e8e tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Going to run 1 instances... {{(pid=108418) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 17:09:52.100817 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-2cf0553b-b1a0-482f-9ada-b145c3844e8e tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 90cb7d6a-93e4-427e-bdba-de422d89fa0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22ce6e29-f3a7-49f0-b93a-ddbffa14e44e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108418) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 17:09:52.144598 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-14416fbd-9148-4bf6-8f64-f4a70c1e1d85 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:52.146923 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-2cf0553b-b1a0-482f-9ada-b145c3844e8e tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.624800 Sep 02 17:09:52.153051 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 111/229] 10.222.0.41 () {60 vars in 1147 bytes} [Thu Sep 2 17:09:51 2021] POST /compute/v2.1/servers => generated 380 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 17:09:52.153218 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-14416fbd-9148-4bf6-8f64-f4a70c1e1d85 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:52.161029 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-14416fbd-9148-4bf6-8f64-f4a70c1e1d85 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:52.161623 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-14416fbd-9148-4bf6-8f64-f4a70c1e1d85 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:52.162516 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-14416fbd-9148-4bf6-8f64-f4a70c1e1d85 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:52.163125 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-14416fbd-9148-4bf6-8f64-f4a70c1e1d85 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:52.164976 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-72a29673-a67f-4a53-a308-059436da119c tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:52.165794 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-72a29673-a67f-4a53-a308-059436da119c tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 90cb7d6a-93e4-427e-bdba-de422d89fa0f] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:52.238589 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-72a29673-a67f-4a53-a308-059436da119c tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:52.245833 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-72a29673-a67f-4a53-a308-059436da119c tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f" status: 200 len: 1219 microversion: 2.1 time: 0.088585 Sep 02 17:09:52.246829 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 112/230] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:52 2021] GET /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:52.315548 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-14416fbd-9148-4bf6-8f64-f4a70c1e1d85 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 14 microversion: 2.20 time: 0.174628 Sep 02 17:09:52.316338 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 119/231] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:09:52 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 14 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:09:52.333448 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-28df375e-5922-4105-996a-1f3e87393e28 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:52.334416 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-28df375e-5922-4105-996a-1f3e87393e28 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:52.342223 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-28df375e-5922-4105-996a-1f3e87393e28 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:52.342822 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-28df375e-5922-4105-996a-1f3e87393e28 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:52.343674 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-28df375e-5922-4105-996a-1f3e87393e28 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:52.344386 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-28df375e-5922-4105-996a-1f3e87393e28 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:52.361181 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-89dcb729-63b3-46af-8380-2ab7fb9f850b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:52.362493 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-89dcb729-63b3-46af-8380-2ab7fb9f850b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:52.370360 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-89dcb729-63b3-46af-8380-2ab7fb9f850b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:52.371063 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-89dcb729-63b3-46af-8380-2ab7fb9f850b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:52.372042 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-89dcb729-63b3-46af-8380-2ab7fb9f850b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:52.372679 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-89dcb729-63b3-46af-8380-2ab7fb9f850b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:52.521778 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-28df375e-5922-4105-996a-1f3e87393e28 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 14 microversion: 2.1 time: 0.190998 Sep 02 17:09:52.526423 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 113/232] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:09:52 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 14 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 17:09:52.533401 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-89dcb729-63b3-46af-8380-2ab7fb9f850b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:52.541884 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-89dcb729-63b3-46af-8380-2ab7fb9f850b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1522 microversion: 2.1 time: 0.185502 Sep 02 17:09:52.542851 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 120/233] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:52 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:52.845525 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-71b85a1f-ce44-44e1-a6c0-633977a5df1c tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:52.846225 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-71b85a1f-ce44-44e1-a6c0-633977a5df1c tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 63d568ab-141d-4831-94e8-31e3b983dd4a] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:52.853525 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-71b85a1f-ce44-44e1-a6c0-633977a5df1c tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:52.854086 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-71b85a1f-ce44-44e1-a6c0-633977a5df1c tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:52.854770 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-71b85a1f-ce44-44e1-a6c0-633977a5df1c tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:52.855369 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-71b85a1f-ce44-44e1-a6c0-633977a5df1c tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:53.008111 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-71b85a1f-ce44-44e1-a6c0-633977a5df1c tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:53.021259 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-71b85a1f-ce44-44e1-a6c0-633977a5df1c tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a" status: 200 len: 1317 microversion: 2.1 time: 0.179470 Sep 02 17:09:53.022099 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 114/234] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:52 2021] GET /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:53.082880 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-a490a286-5cdc-465a-bd96-ef9175715eda tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:53.083563 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-a490a286-5cdc-465a-bd96-ef9175715eda tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] [instance: 731fe663-d306-40c9-bc5b-af255b67d8d8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:53.089825 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a490a286-5cdc-465a-bd96-ef9175715eda tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:53.090276 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a490a286-5cdc-465a-bd96-ef9175715eda tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:53.091457 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a490a286-5cdc-465a-bd96-ef9175715eda tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:53.092332 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a490a286-5cdc-465a-bd96-ef9175715eda tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:53.108835 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.wsgi [None req-a490a286-5cdc-465a-bd96-ef9175715eda tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] HTTP exception thrown: Instance 731fe663-d306-40c9-bc5b-af255b67d8d8 could not be found. Sep 02 17:09:53.109442 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-a490a286-5cdc-465a-bd96-ef9175715eda tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Returning 404 to user: Instance 731fe663-d306-40c9-bc5b-af255b67d8d8 could not be found. {{(pid=108417) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:09:53.110802 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-a490a286-5cdc-465a-bd96-ef9175715eda tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] 10.222.0.41 "GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8" status: 404 len: 111 microversion: 2.1 time: 0.031435 Sep 02 17:09:53.111542 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 121/235] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:53 2021] GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 17:09:53.244281 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-c9f41bf6-47c8-4042-aaa5-4bf28fdfa479 req-625bf880-84ee-4234-9b91-5cefa4d8a280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d568ab-141d-4831-94e8-31e3b983dd4a", "name": "network-vif-plugged", "status": "completed", "tag": "3e150f1a-44ff-4964-8378-9720427117af"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:53.247043 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-a60a54b0-a697-4685-a3d3-327b3e1974d3 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:53.247798 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-a60a54b0-a697-4685-a3d3-327b3e1974d3 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] [instance: 731fe663-d306-40c9-bc5b-af255b67d8d8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:53.248353 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:09:53.248353 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:09:53.263195 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a60a54b0-a697-4685-a3d3-327b3e1974d3 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:53.263648 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a60a54b0-a697-4685-a3d3-327b3e1974d3 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:53.264451 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a60a54b0-a697-4685-a3d3-327b3e1974d3 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:53.264910 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-c9f41bf6-47c8-4042-aaa5-4bf28fdfa479 req-625bf880-84ee-4234-9b91-5cefa4d8a280 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:53.265350 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-c9f41bf6-47c8-4042-aaa5-4bf28fdfa479 req-625bf880-84ee-4234-9b91-5cefa4d8a280 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:53.269465 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a60a54b0-a697-4685-a3d3-327b3e1974d3 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:53.279596 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-c9f41bf6-47c8-4042-aaa5-4bf28fdfa479 req-625bf880-84ee-4234-9b91-5cefa4d8a280 service nova] Creating event network-vif-plugged:3e150f1a-44ff-4964-8378-9720427117af for instance 63d568ab-141d-4831-94e8-31e3b983dd4a on hv-cinder-80626 Sep 02 17:09:53.286090 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-c9f41bf6-47c8-4042-aaa5-4bf28fdfa479 req-625bf880-84ee-4234-9b91-5cefa4d8a280 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052279 Sep 02 17:09:53.287553 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 115/236] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:09:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:09:53.289100 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.wsgi [None req-a60a54b0-a697-4685-a3d3-327b3e1974d3 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] HTTP exception thrown: Instance 731fe663-d306-40c9-bc5b-af255b67d8d8 could not be found. Sep 02 17:09:53.289975 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-a60a54b0-a697-4685-a3d3-327b3e1974d3 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Returning 404 to user: Instance 731fe663-d306-40c9-bc5b-af255b67d8d8 could not be found. {{(pid=108417) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:09:53.290953 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-a60a54b0-a697-4685-a3d3-327b3e1974d3 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] 10.222.0.41 "GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.059069 Sep 02 17:09:53.293882 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 122/237] 10.222.0.41 () {58 vars in 1302 bytes} [Thu Sep 2 17:09:53 2021] GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8/os-volume_attachments => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 17:09:53.294256 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-6c19d400-0597-46b8-9238-094e6595d332 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:53.295518 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-6c19d400-0597-46b8-9238-094e6595d332 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 90cb7d6a-93e4-427e-bdba-de422d89fa0f] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:53.312815 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6c19d400-0597-46b8-9238-094e6595d332 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:53.313300 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6c19d400-0597-46b8-9238-094e6595d332 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:53.314673 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6c19d400-0597-46b8-9238-094e6595d332 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:53.315120 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6c19d400-0597-46b8-9238-094e6595d332 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:53.328200 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-78f2c3dd-6e7e-4399-aa13-40f1f5a8c75f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:53.329222 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-78f2c3dd-6e7e-4399-aa13-40f1f5a8c75f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:53.369975 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-78f2c3dd-6e7e-4399-aa13-40f1f5a8c75f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:53.371110 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-78f2c3dd-6e7e-4399-aa13-40f1f5a8c75f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:53.372265 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-78f2c3dd-6e7e-4399-aa13-40f1f5a8c75f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:53.381662 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-78f2c3dd-6e7e-4399-aa13-40f1f5a8c75f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:53.405130 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-6c19d400-0597-46b8-9238-094e6595d332 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:53.413984 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-6c19d400-0597-46b8-9238-094e6595d332 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f" status: 200 len: 1271 microversion: 2.1 time: 0.124385 Sep 02 17:09:53.415567 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 116/238] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:53 2021] GET /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f => generated 1271 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:53.533675 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-36931e6d-687f-442e-bc64-8a832cb46a4e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:53.540577 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-36931e6d-687f-442e-bc64-8a832cb46a4e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:53.555650 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-36931e6d-687f-442e-bc64-8a832cb46a4e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:53.556468 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-36931e6d-687f-442e-bc64-8a832cb46a4e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:53.557624 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-36931e6d-687f-442e-bc64-8a832cb46a4e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:53.558689 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-36931e6d-687f-442e-bc64-8a832cb46a4e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:53.754395 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-78f2c3dd-6e7e-4399-aa13-40f1f5a8c75f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 14 microversion: 2.20 time: 0.431094 Sep 02 17:09:53.758604 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 123/239] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:09:53 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 14 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:53.764164 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-6cf1d4ff-a655-4fa6-8922-a845dc2167d2 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:53.764934 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-6cf1d4ff-a655-4fa6-8922-a845dc2167d2 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:53.775918 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-36931e6d-687f-442e-bc64-8a832cb46a4e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 14 microversion: 2.1 time: 0.246289 Sep 02 17:09:53.780061 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 117/240] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:09:53 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 14 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 17:09:53.786833 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6cf1d4ff-a655-4fa6-8922-a845dc2167d2 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:53.787415 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6cf1d4ff-a655-4fa6-8922-a845dc2167d2 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:53.788454 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6cf1d4ff-a655-4fa6-8922-a845dc2167d2 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:53.788849 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6cf1d4ff-a655-4fa6-8922-a845dc2167d2 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:53.955436 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-6cf1d4ff-a655-4fa6-8922-a845dc2167d2 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:53.963531 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-6cf1d4ff-a655-4fa6-8922-a845dc2167d2 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1522 microversion: 2.1 time: 0.203499 Sep 02 17:09:53.964082 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 124/241] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:53 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:54.039650 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-46c49f69-4d8c-4ff6-9c80-6258391c10fb tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:54.040467 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-46c49f69-4d8c-4ff6-9c80-6258391c10fb tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 63d568ab-141d-4831-94e8-31e3b983dd4a] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:54.047265 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-46c49f69-4d8c-4ff6-9c80-6258391c10fb tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:54.047713 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-46c49f69-4d8c-4ff6-9c80-6258391c10fb tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:54.048474 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-46c49f69-4d8c-4ff6-9c80-6258391c10fb tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:54.048904 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-46c49f69-4d8c-4ff6-9c80-6258391c10fb tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:54.187893 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-46c49f69-4d8c-4ff6-9c80-6258391c10fb tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:54.197334 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-46c49f69-4d8c-4ff6-9c80-6258391c10fb tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a" status: 200 len: 1317 microversion: 2.1 time: 0.161537 Sep 02 17:09:54.197903 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 118/242] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:54 2021] GET /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:54.433048 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-eaca875c-5646-44ff-943a-0cd6161dadad tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:54.434264 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-eaca875c-5646-44ff-943a-0cd6161dadad tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 90cb7d6a-93e4-427e-bdba-de422d89fa0f] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:54.441999 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-eaca875c-5646-44ff-943a-0cd6161dadad tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:54.442450 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-eaca875c-5646-44ff-943a-0cd6161dadad tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:54.443627 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-eaca875c-5646-44ff-943a-0cd6161dadad tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:54.444005 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-eaca875c-5646-44ff-943a-0cd6161dadad tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:54.528678 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-eaca875c-5646-44ff-943a-0cd6161dadad tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:54.537576 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-eaca875c-5646-44ff-943a-0cd6161dadad tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f" status: 200 len: 1277 microversion: 2.1 time: 0.108764 Sep 02 17:09:54.539682 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 125/243] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:54 2021] GET /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f => generated 1277 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:54.555922 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-ec97d316-e9b4-4722-849e-b7c73201b672 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:54.556435 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-ec97d316-e9b4-4722-849e-b7c73201b672 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] [instance: 731fe663-d306-40c9-bc5b-af255b67d8d8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:54.562983 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ec97d316-e9b4-4722-849e-b7c73201b672 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:54.563682 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ec97d316-e9b4-4722-849e-b7c73201b672 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:54.564622 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ec97d316-e9b4-4722-849e-b7c73201b672 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:54.565061 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ec97d316-e9b4-4722-849e-b7c73201b672 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:54.580344 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.wsgi [None req-ec97d316-e9b4-4722-849e-b7c73201b672 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] HTTP exception thrown: Instance 731fe663-d306-40c9-bc5b-af255b67d8d8 could not be found. Sep 02 17:09:54.580940 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-ec97d316-e9b4-4722-849e-b7c73201b672 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Returning 404 to user: Instance 731fe663-d306-40c9-bc5b-af255b67d8d8 could not be found. {{(pid=108418) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:09:54.581787 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-ec97d316-e9b4-4722-849e-b7c73201b672 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] 10.222.0.41 "DELETE /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8" status: 404 len: 111 microversion: 2.1 time: 0.030313 Sep 02 17:09:54.583034 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 119/244] 10.222.0.41 () {58 vars in 1239 bytes} [Thu Sep 2 17:09:54 2021] DELETE /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 17:09:54.590968 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-71f09f71-dc95-4eaa-9375-cba907625e22 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:54.593893 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-71f09f71-dc95-4eaa-9375-cba907625e22 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] [instance: 731fe663-d306-40c9-bc5b-af255b67d8d8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:54.600135 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-71f09f71-dc95-4eaa-9375-cba907625e22 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:54.600798 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-71f09f71-dc95-4eaa-9375-cba907625e22 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:54.602184 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-71f09f71-dc95-4eaa-9375-cba907625e22 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:54.603106 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-71f09f71-dc95-4eaa-9375-cba907625e22 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:54.620170 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.wsgi [None req-71f09f71-dc95-4eaa-9375-cba907625e22 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] HTTP exception thrown: Instance 731fe663-d306-40c9-bc5b-af255b67d8d8 could not be found. Sep 02 17:09:54.621301 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-71f09f71-dc95-4eaa-9375-cba907625e22 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] Returning 404 to user: Instance 731fe663-d306-40c9-bc5b-af255b67d8d8 could not be found. {{(pid=108417) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:09:54.622748 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-71f09f71-dc95-4eaa-9375-cba907625e22 tempest-DeleteServersTestJSON-874707757 tempest-DeleteServersTestJSON-874707757-project] 10.222.0.41 "GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8" status: 404 len: 111 microversion: 2.1 time: 0.035265 Sep 02 17:09:54.623574 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 126/245] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:54 2021] GET /compute/v2.1/servers/731fe663-d306-40c9-bc5b-af255b67d8d8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 17:09:54.773411 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-afad7b44-dac0-437e-8ed0-d1c83b69c176 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:54.774729 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-afad7b44-dac0-437e-8ed0-d1c83b69c176 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:54.788243 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-eae64a01-a0d2-437c-86de-aa9329c63b67 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:54.789561 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-eae64a01-a0d2-437c-86de-aa9329c63b67 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:54.797550 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-afad7b44-dac0-437e-8ed0-d1c83b69c176 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:54.798202 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-afad7b44-dac0-437e-8ed0-d1c83b69c176 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:54.799404 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-afad7b44-dac0-437e-8ed0-d1c83b69c176 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:54.800074 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-afad7b44-dac0-437e-8ed0-d1c83b69c176 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:54.802555 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-eae64a01-a0d2-437c-86de-aa9329c63b67 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:54.803235 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-eae64a01-a0d2-437c-86de-aa9329c63b67 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:54.804233 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-eae64a01-a0d2-437c-86de-aa9329c63b67 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:54.806817 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-eae64a01-a0d2-437c-86de-aa9329c63b67 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:54.943090 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-afad7b44-dac0-437e-8ed0-d1c83b69c176 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 14 microversion: 2.20 time: 0.181415 Sep 02 17:09:54.946749 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 120/246] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:09:54 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 14 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:54.983889 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-eae64a01-a0d2-437c-86de-aa9329c63b67 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 14 microversion: 2.1 time: 0.199870 Sep 02 17:09:54.984504 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 127/247] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:09:54 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 14 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 02 17:09:54.984757 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-55735d53-5bd5-4d67-8c99-abecec17eb21 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:54.986455 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-55735d53-5bd5-4d67-8c99-abecec17eb21 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:55.003041 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-55735d53-5bd5-4d67-8c99-abecec17eb21 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:55.003768 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-55735d53-5bd5-4d67-8c99-abecec17eb21 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:55.004648 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-55735d53-5bd5-4d67-8c99-abecec17eb21 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:55.007083 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-55735d53-5bd5-4d67-8c99-abecec17eb21 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:55.214615 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-92eeb475-3748-4d44-a920-86cd063cd988 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:55.215606 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-92eeb475-3748-4d44-a920-86cd063cd988 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 63d568ab-141d-4831-94e8-31e3b983dd4a] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:55.228175 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-92eeb475-3748-4d44-a920-86cd063cd988 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:55.228914 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-92eeb475-3748-4d44-a920-86cd063cd988 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:55.244929 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-92eeb475-3748-4d44-a920-86cd063cd988 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:55.244929 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-92eeb475-3748-4d44-a920-86cd063cd988 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:55.252073 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-55735d53-5bd5-4d67-8c99-abecec17eb21 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:55.267759 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-55735d53-5bd5-4d67-8c99-abecec17eb21 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1522 microversion: 2.1 time: 0.290721 Sep 02 17:09:55.272398 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 121/248] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:54 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1522 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:55.525180 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-92eeb475-3748-4d44-a920-86cd063cd988 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:55.533706 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-92eeb475-3748-4d44-a920-86cd063cd988 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a" status: 200 len: 1317 microversion: 2.1 time: 0.323085 Sep 02 17:09:55.534182 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 128/249] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:55 2021] GET /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a => generated 1317 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:09:55.555857 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-a780fdc7-c188-4fc6-b7a7-2cf2fc545401 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:55.556461 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-a780fdc7-c188-4fc6-b7a7-2cf2fc545401 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 90cb7d6a-93e4-427e-bdba-de422d89fa0f] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:55.563968 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a780fdc7-c188-4fc6-b7a7-2cf2fc545401 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:55.564415 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a780fdc7-c188-4fc6-b7a7-2cf2fc545401 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:55.565184 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a780fdc7-c188-4fc6-b7a7-2cf2fc545401 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:55.565609 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a780fdc7-c188-4fc6-b7a7-2cf2fc545401 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:55.695601 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-a780fdc7-c188-4fc6-b7a7-2cf2fc545401 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:55.703803 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-a780fdc7-c188-4fc6-b7a7-2cf2fc545401 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f" status: 200 len: 1319 microversion: 2.1 time: 0.152412 Sep 02 17:09:55.704574 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 122/250] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:55 2021] GET /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:55.771188 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [req-1f6e0bab-7cbb-4da7-b267-733a7070688b req-c5a4daae-1596-449d-8523-82da0a487141 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90cb7d6a-93e4-427e-bdba-de422d89fa0f", "tag": "e9dda3e8-e3cc-41ac-a8ce-42eacc3fc937"}]} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:55.774249 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:09:55.774249 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: warnings.warn(msg) Sep 02 17:09:55.789685 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-1f6e0bab-7cbb-4da7-b267-733a7070688b req-c5a4daae-1596-449d-8523-82da0a487141 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:55.790322 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-1f6e0bab-7cbb-4da7-b267-733a7070688b req-c5a4daae-1596-449d-8523-82da0a487141 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:55.805513 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.compute.server_external_events [req-1f6e0bab-7cbb-4da7-b267-733a7070688b req-c5a4daae-1596-449d-8523-82da0a487141 service nova] Creating event network-changed:e9dda3e8-e3cc-41ac-a8ce-42eacc3fc937 for instance 90cb7d6a-93e4-427e-bdba-de422d89fa0f on hv-cinder-80626 Sep 02 17:09:55.810985 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [req-1f6e0bab-7cbb-4da7-b267-733a7070688b req-c5a4daae-1596-449d-8523-82da0a487141 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043670 Sep 02 17:09:55.812124 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 129/251] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:09:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:09:55.958418 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-a8a1a998-b5a3-4483-8299-ff900ce41e36 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:55.960257 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-a8a1a998-b5a3-4483-8299-ff900ce41e36 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:55.967737 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a8a1a998-b5a3-4483-8299-ff900ce41e36 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:55.968549 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a8a1a998-b5a3-4483-8299-ff900ce41e36 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:55.969785 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a8a1a998-b5a3-4483-8299-ff900ce41e36 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:55.970746 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a8a1a998-b5a3-4483-8299-ff900ce41e36 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:55.995215 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-75358c65-df02-45c6-b776-d97b51b229f1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:55.996298 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-75358c65-df02-45c6-b776-d97b51b229f1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:56.005938 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-75358c65-df02-45c6-b776-d97b51b229f1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:56.006733 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-75358c65-df02-45c6-b776-d97b51b229f1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:56.008120 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-75358c65-df02-45c6-b776-d97b51b229f1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:56.008587 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-75358c65-df02-45c6-b776-d97b51b229f1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:56.140489 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-a8a1a998-b5a3-4483-8299-ff900ce41e36 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 14 microversion: 2.20 time: 0.187364 Sep 02 17:09:56.141233 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 123/252] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:09:55 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 14 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:09:56.166891 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-75358c65-df02-45c6-b776-d97b51b229f1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 14 microversion: 2.1 time: 0.175957 Sep 02 17:09:56.167856 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 130/253] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:09:55 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 14 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 02 17:09:56.291220 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-b57f9c98-e6d2-4ea0-9097-da403600442c tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:56.292022 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-b57f9c98-e6d2-4ea0-9097-da403600442c tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:56.298512 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b57f9c98-e6d2-4ea0-9097-da403600442c tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:56.299085 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b57f9c98-e6d2-4ea0-9097-da403600442c tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:56.299920 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b57f9c98-e6d2-4ea0-9097-da403600442c tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:56.300417 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b57f9c98-e6d2-4ea0-9097-da403600442c tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:56.448410 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-b57f9c98-e6d2-4ea0-9097-da403600442c tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:56.456191 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-b57f9c98-e6d2-4ea0-9097-da403600442c tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1522 microversion: 2.1 time: 0.169494 Sep 02 17:09:56.456884 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 124/254] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:56 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:56.550559 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-d8b64f0f-e37c-4109-a7b9-99dfa71d0c8e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:56.551284 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-d8b64f0f-e37c-4109-a7b9-99dfa71d0c8e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 63d568ab-141d-4831-94e8-31e3b983dd4a] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:56.558225 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d8b64f0f-e37c-4109-a7b9-99dfa71d0c8e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:56.558694 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d8b64f0f-e37c-4109-a7b9-99dfa71d0c8e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:56.560098 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d8b64f0f-e37c-4109-a7b9-99dfa71d0c8e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:56.560613 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d8b64f0f-e37c-4109-a7b9-99dfa71d0c8e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:56.691191 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-d8b64f0f-e37c-4109-a7b9-99dfa71d0c8e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:56.699045 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-d8b64f0f-e37c-4109-a7b9-99dfa71d0c8e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a" status: 200 len: 1507 microversion: 2.1 time: 0.152385 Sep 02 17:09:56.699604 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 131/255] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:56 2021] GET /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:56.721260 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-e3b53e12-9128-4b9b-a996-5e9f3fc97352 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:56.721906 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-e3b53e12-9128-4b9b-a996-5e9f3fc97352 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 90cb7d6a-93e4-427e-bdba-de422d89fa0f] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:56.734102 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e3b53e12-9128-4b9b-a996-5e9f3fc97352 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:56.734865 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e3b53e12-9128-4b9b-a996-5e9f3fc97352 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:56.736155 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e3b53e12-9128-4b9b-a996-5e9f3fc97352 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:56.736748 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e3b53e12-9128-4b9b-a996-5e9f3fc97352 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:56.760449 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-7b3ec4f6-fec8-4c7d-9fa2-23d25b5fa468 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d99da6ac-1df8-412b-9d5a-a1fc708e74aa"}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:56.761646 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-7b3ec4f6-fec8-4c7d-9fa2-23d25b5fa468 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 63d568ab-141d-4831-94e8-31e3b983dd4a] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:56.768353 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7b3ec4f6-fec8-4c7d-9fa2-23d25b5fa468 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:56.768999 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7b3ec4f6-fec8-4c7d-9fa2-23d25b5fa468 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:56.770158 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7b3ec4f6-fec8-4c7d-9fa2-23d25b5fa468 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:56.770958 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7b3ec4f6-fec8-4c7d-9fa2-23d25b5fa468 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:56.866243 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.wsgi [None req-7b3ec4f6-fec8-4c7d-9fa2-23d25b5fa468 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] HTTP exception thrown: Invalid volume: volume d99da6ac-1df8-412b-9d5a-a1fc708e74aa is already attached to instances: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 Sep 02 17:09:56.867469 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-7b3ec4f6-fec8-4c7d-9fa2-23d25b5fa468 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Returning 400 to user: Invalid volume: volume d99da6ac-1df8-412b-9d5a-a1fc708e74aa is already attached to instances: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 {{(pid=108417) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:09:56.868750 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-7b3ec4f6-fec8-4c7d-9fa2-23d25b5fa468 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "POST /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.112008 Sep 02 17:09:56.881407 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 132/256] 10.222.0.41 () {60 vars in 1323 bytes} [Thu Sep 2 17:09:56 2021] POST /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a/os-volume_attachments => generated 174 bytes in 125 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 17:09:56.887933 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-e3b53e12-9128-4b9b-a996-5e9f3fc97352 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:09:56.899987 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-e3b53e12-9128-4b9b-a996-5e9f3fc97352 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f" status: 200 len: 1319 microversion: 2.1 time: 0.182169 Sep 02 17:09:56.905136 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 125/257] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:09:56 2021] GET /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:09:56.950303 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-a414c346-3158-4427-8fe9-cf22fb184346 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:09:56.950745 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-a414c346-3158-4427-8fe9-cf22fb184346 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:56.956438 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a414c346-3158-4427-8fe9-cf22fb184346 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:56.956875 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a414c346-3158-4427-8fe9-cf22fb184346 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:56.957661 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a414c346-3158-4427-8fe9-cf22fb184346 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:56.958085 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a414c346-3158-4427-8fe9-cf22fb184346 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:57.097639 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.objects.instance [None req-a414c346-3158-4427-8fe9-cf22fb184346 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lazy-loading 'services' on Instance uuid fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 {{(pid=108417) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 17:09:57.153690 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-272363d7-d045-4d03-aca9-975e1db38cdd tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:57.154858 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-272363d7-d045-4d03-aca9-975e1db38cdd tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:57.160896 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-272363d7-d045-4d03-aca9-975e1db38cdd tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:57.161342 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-272363d7-d045-4d03-aca9-975e1db38cdd tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:57.162497 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-272363d7-d045-4d03-aca9-975e1db38cdd tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:57.163033 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-272363d7-d045-4d03-aca9-975e1db38cdd tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:57.221509 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-a414c346-3158-4427-8fe9-cf22fb184346 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "DELETE /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97/os-volume_attachments/d99da6ac-1df8-412b-9d5a-a1fc708e74aa" status: 202 len: 0 microversion: 2.1 time: 0.274813 Sep 02 17:09:57.222332 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 133/258] 10.222.0.41 () {58 vars in 1416 bytes} [Thu Sep 2 17:09:56 2021] DELETE /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97/os-volume_attachments/d99da6ac-1df8-412b-9d5a-a1fc708e74aa => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:09:57.227840 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-9acd2dbd-cbe6-4c0b-be68-c8b31493d5ae tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:09:57.228844 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-9acd2dbd-cbe6-4c0b-be68-c8b31493d5ae tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:09:57.235523 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9acd2dbd-cbe6-4c0b-be68-c8b31493d5ae tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:57.235968 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9acd2dbd-cbe6-4c0b-be68-c8b31493d5ae tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:09:57.236751 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9acd2dbd-cbe6-4c0b-be68-c8b31493d5ae tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:09:57.237190 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9acd2dbd-cbe6-4c0b-be68-c8b31493d5ae tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:00.004755 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-9acd2dbd-cbe6-4c0b-be68-c8b31493d5ae tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 9491 microversion: 2.1 time: 2.780754 Sep 02 17:10:00.005444 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 134/259] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:09:57 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 9491 bytes in 2782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:00.010841 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-5d6f7791-716b-4d09-8e21-96d2c7c0c4e1 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:00.011809 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-5d6f7791-716b-4d09-8e21-96d2c7c0c4e1 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:00.019272 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5d6f7791-716b-4d09-8e21-96d2c7c0c4e1 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:00.019714 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5d6f7791-716b-4d09-8e21-96d2c7c0c4e1 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:00.020487 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5d6f7791-716b-4d09-8e21-96d2c7c0c4e1 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:00.020914 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5d6f7791-716b-4d09-8e21-96d2c7c0c4e1 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:00.053856 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-5d6f7791-716b-4d09-8e21-96d2c7c0c4e1 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046896 Sep 02 17:10:00.054435 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 135/260] 10.222.0.41 () {58 vars in 1302 bytes} [Thu Sep 2 17:10:00 2021] GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:10:00.059597 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-1300a75e-c29c-4d4a-a579-d364c00b86e7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:00.060812 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-1300a75e-c29c-4d4a-a579-d364c00b86e7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:00.068798 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-272363d7-d045-4d03-aca9-975e1db38cdd tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 15064 microversion: 2.20 time: 2.918657 Sep 02 17:10:00.071265 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1300a75e-c29c-4d4a-a579-d364c00b86e7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:00.072203 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1300a75e-c29c-4d4a-a579-d364c00b86e7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:00.073488 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 126/261] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:09:57 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 15064 bytes in 2925 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:10:00.074373 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1300a75e-c29c-4d4a-a579-d364c00b86e7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:00.075489 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1300a75e-c29c-4d4a-a579-d364c00b86e7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:00.084581 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-f42a64ab-a53a-4c21-b922-fe428cb92016 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:00.085903 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-f42a64ab-a53a-4c21-b922-fe428cb92016 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 90cb7d6a-93e4-427e-bdba-de422d89fa0f] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:00.095376 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f42a64ab-a53a-4c21-b922-fe428cb92016 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:00.096076 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f42a64ab-a53a-4c21-b922-fe428cb92016 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:00.097056 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f42a64ab-a53a-4c21-b922-fe428cb92016 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:00.097632 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f42a64ab-a53a-4c21-b922-fe428cb92016 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:00.244199 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-f42a64ab-a53a-4c21-b922-fe428cb92016 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:00.265247 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-f42a64ab-a53a-4c21-b922-fe428cb92016 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f" status: 200 len: 1319 microversion: 2.1 time: 0.189418 Sep 02 17:10:00.266990 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 127/262] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:00 2021] GET /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:00.307894 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-1300a75e-c29c-4d4a-a579-d364c00b86e7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:00.315661 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-1300a75e-c29c-4d4a-a579-d364c00b86e7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1522 microversion: 2.1 time: 0.260177 Sep 02 17:10:00.316470 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 136/263] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:00 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1522 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:01.017538 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-192e5d72-6e1c-4022-8d89-6711b2fd7a49 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:01.018468 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-192e5d72-6e1c-4022-8d89-6711b2fd7a49 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:01.024834 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-192e5d72-6e1c-4022-8d89-6711b2fd7a49 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:01.025273 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-192e5d72-6e1c-4022-8d89-6711b2fd7a49 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:01.026024 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-192e5d72-6e1c-4022-8d89-6711b2fd7a49 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:01.026468 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-192e5d72-6e1c-4022-8d89-6711b2fd7a49 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:01.065582 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-a68744d2-0555-43ef-8eec-83c839595227 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:01.066546 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-a68744d2-0555-43ef-8eec-83c839595227 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:01.073244 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a68744d2-0555-43ef-8eec-83c839595227 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:01.073696 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a68744d2-0555-43ef-8eec-83c839595227 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:01.074464 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a68744d2-0555-43ef-8eec-83c839595227 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:01.075086 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a68744d2-0555-43ef-8eec-83c839595227 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:01.105284 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-a68744d2-0555-43ef-8eec-83c839595227 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043630 Sep 02 17:10:01.105852 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 137/264] 10.222.0.41 () {58 vars in 1302 bytes} [Thu Sep 2 17:10:01 2021] GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:10:01.110499 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-af014d33-842e-4825-8f3c-c9032db134b6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:01.111465 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-af014d33-842e-4825-8f3c-c9032db134b6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:01.117240 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-af014d33-842e-4825-8f3c-c9032db134b6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:01.117689 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-af014d33-842e-4825-8f3c-c9032db134b6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:01.118476 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-af014d33-842e-4825-8f3c-c9032db134b6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:01.118943 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-af014d33-842e-4825-8f3c-c9032db134b6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:01.174223 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-192e5d72-6e1c-4022-8d89-6711b2fd7a49 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 12931 microversion: 2.1 time: 0.155762 Sep 02 17:10:01.174223 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 128/265] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:01 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 12931 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:10:01.246867 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-af014d33-842e-4825-8f3c-c9032db134b6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 16782 microversion: 2.20 time: 0.139611 Sep 02 17:10:01.247510 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 138/266] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:10:01 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 16782 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:10:01.285003 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-219f243a-04d2-4ffd-b13b-265e0e580d59 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:01.285596 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-219f243a-04d2-4ffd-b13b-265e0e580d59 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 90cb7d6a-93e4-427e-bdba-de422d89fa0f] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:01.292286 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-219f243a-04d2-4ffd-b13b-265e0e580d59 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:01.292740 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-219f243a-04d2-4ffd-b13b-265e0e580d59 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:01.293650 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-219f243a-04d2-4ffd-b13b-265e0e580d59 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:01.294082 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-219f243a-04d2-4ffd-b13b-265e0e580d59 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:01.333838 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-5a4e45fa-ace4-4775-bbf6-2bee1a353bf7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:01.335510 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-5a4e45fa-ace4-4775-bbf6-2bee1a353bf7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:01.341503 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5a4e45fa-ace4-4775-bbf6-2bee1a353bf7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:01.341946 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5a4e45fa-ace4-4775-bbf6-2bee1a353bf7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:01.342759 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5a4e45fa-ace4-4775-bbf6-2bee1a353bf7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:01.343454 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5a4e45fa-ace4-4775-bbf6-2bee1a353bf7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:01.437654 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-219f243a-04d2-4ffd-b13b-265e0e580d59 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:01.460147 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-219f243a-04d2-4ffd-b13b-265e0e580d59 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f" status: 200 len: 1319 microversion: 2.1 time: 0.178957 Sep 02 17:10:01.474437 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 129/267] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:01 2021] GET /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:01.496580 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-5a4e45fa-ace4-4775-bbf6-2bee1a353bf7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:01.504587 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-5a4e45fa-ace4-4775-bbf6-2bee1a353bf7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1522 microversion: 2.1 time: 0.175362 Sep 02 17:10:01.505152 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 139/268] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:01 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:10:02.116553 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-923e5370-5604-40e6-bc74-ce84fad2b41e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:02.117961 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-923e5370-5604-40e6-bc74-ce84fad2b41e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:02.124248 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-923e5370-5604-40e6-bc74-ce84fad2b41e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:02.124695 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-923e5370-5604-40e6-bc74-ce84fad2b41e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:02.125462 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-923e5370-5604-40e6-bc74-ce84fad2b41e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:02.125896 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-923e5370-5604-40e6-bc74-ce84fad2b41e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:02.154378 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-923e5370-5604-40e6-bc74-ce84fad2b41e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041598 Sep 02 17:10:02.154951 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 130/269] 10.222.0.41 () {58 vars in 1302 bytes} [Thu Sep 2 17:10:02 2021] GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 17:10:02.181109 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-23300a68-8cc6-4418-bd49-a67e7d4b9a49 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:02.182019 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-23300a68-8cc6-4418-bd49-a67e7d4b9a49 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:02.187659 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-23300a68-8cc6-4418-bd49-a67e7d4b9a49 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:02.188099 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-23300a68-8cc6-4418-bd49-a67e7d4b9a49 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:02.188859 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-23300a68-8cc6-4418-bd49-a67e7d4b9a49 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:02.189292 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-23300a68-8cc6-4418-bd49-a67e7d4b9a49 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:02.259351 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-c9eee944-2e7e-4c2d-b38d-8f5f4257f4bc tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:02.260278 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-c9eee944-2e7e-4c2d-b38d-8f5f4257f4bc tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:02.265980 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c9eee944-2e7e-4c2d-b38d-8f5f4257f4bc tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:02.266426 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c9eee944-2e7e-4c2d-b38d-8f5f4257f4bc tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:02.267225 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c9eee944-2e7e-4c2d-b38d-8f5f4257f4bc tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:02.267672 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c9eee944-2e7e-4c2d-b38d-8f5f4257f4bc tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:05.320817 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-23300a68-8cc6-4418-bd49-a67e7d4b9a49 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 19342 microversion: 2.1 time: 3.143610 Sep 02 17:10:05.325352 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 140/270] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:02 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 19342 bytes in 3145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:10:05.327080 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-da15134b-3aa6-4da4-8706-2d0984b419d0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1772914067", "imageRef": "22ce6e29-f3a7-49f0-b93a-ddbffa14e44e", "flavorRef": "452", "networks": [{"uuid": "42e64c23-8d50-4a89-acaf-802979ed9882"}]}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:05.361106 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-c9eee944-2e7e-4c2d-b38d-8f5f4257f4bc tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 21275 microversion: 2.20 time: 3.101552 Sep 02 17:10:05.361106 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 131/271] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:10:02 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 21275 bytes in 3103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:10:05.363286 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-df4e0032-91e8-428a-9f58-f299a21b4d6f tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:05.364262 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-df4e0032-91e8-428a-9f58-f299a21b4d6f tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 90cb7d6a-93e4-427e-bdba-de422d89fa0f] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:05.376297 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-df4e0032-91e8-428a-9f58-f299a21b4d6f tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:05.376955 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-df4e0032-91e8-428a-9f58-f299a21b4d6f tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:05.377769 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-df4e0032-91e8-428a-9f58-f299a21b4d6f tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:05.378849 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-df4e0032-91e8-428a-9f58-f299a21b4d6f tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:05.388488 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.network.neutron [None req-da15134b-3aa6-4da4-8706-2d0984b419d0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] validate_networks() for [('42e64c23-8d50-4a89-acaf-802979ed9882', None, None, None, None, None)] {{(pid=108417) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 17:10:05.526461 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-df4e0032-91e8-428a-9f58-f299a21b4d6f tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:05.533811 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-df4e0032-91e8-428a-9f58-f299a21b4d6f tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f" status: 200 len: 1319 microversion: 2.1 time: 0.174983 Sep 02 17:10:05.534368 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 132/272] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:05 2021] GET /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:05.543400 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-6f12a060-4785-4b85-a844-bf1dae85e871 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:05.543400 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-6f12a060-4785-4b85-a844-bf1dae85e871 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:05.545345 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6f12a060-4785-4b85-a844-bf1dae85e871 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:05.545791 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6f12a060-4785-4b85-a844-bf1dae85e871 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:05.546574 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6f12a060-4785-4b85-a844-bf1dae85e871 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:05.547031 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6f12a060-4785-4b85-a844-bf1dae85e871 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:05.673566 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-6f12a060-4785-4b85-a844-bf1dae85e871 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:05.680877 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-6f12a060-4785-4b85-a844-bf1dae85e871 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1522 microversion: 2.1 time: 0.145435 Sep 02 17:10:05.681645 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 133/273] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:05 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:05.770296 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-da15134b-3aa6-4da4-8706-2d0984b419d0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Flavor limits 0:0:0 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 17:10:05.770770 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-da15134b-3aa6-4da4-8706-2d0984b419d0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Image limits 0:0:0 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 17:10:05.771243 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-da15134b-3aa6-4da4-8706-2d0984b419d0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Flavor pref 0:0:0 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 17:10:05.771648 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-da15134b-3aa6-4da4-8706-2d0984b419d0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Image pref 0:0:0 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 17:10:05.772053 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-da15134b-3aa6-4da4-8706-2d0984b419d0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 17:10:05.781448 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-da15134b-3aa6-4da4-8706-2d0984b419d0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:05.781887 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-da15134b-3aa6-4da4-8706-2d0984b419d0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:05.782715 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-da15134b-3aa6-4da4-8706-2d0984b419d0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:05.783149 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-da15134b-3aa6-4da4-8706-2d0984b419d0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:05.799397 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.quota [None req-da15134b-3aa6-4da4-8706-2d0984b419d0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Getting quotas for project 9ec1c77ded4a41158a99f6cf578e395e. Resources: {'instances', 'cores', 'ram'} {{(pid=108417) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 17:10:05.803268 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.quota [None req-da15134b-3aa6-4da4-8706-2d0984b419d0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Getting quotas for user 86d5b6fd03e140b3bfbfef7a087063ec and project 9ec1c77ded4a41158a99f6cf578e395e. Resources: {'instances', 'cores', 'ram'} {{(pid=108417) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 17:10:05.814567 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-da15134b-3aa6-4da4-8706-2d0984b419d0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Going to run 1 instances... {{(pid=108417) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 17:10:05.816989 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-da15134b-3aa6-4da4-8706-2d0984b419d0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 824de352-7b8c-4ab6-8e42-1958f7b70c25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22ce6e29-f3a7-49f0-b93a-ddbffa14e44e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108417) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 17:10:05.861343 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-da15134b-3aa6-4da4-8706-2d0984b419d0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.538346 Sep 02 17:10:05.861972 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 141/274] 10.222.0.41 () {60 vars in 1147 bytes} [Thu Sep 2 17:10:05 2021] POST /compute/v2.1/servers => generated 380 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 17:10:05.871862 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-0cc7e34a-8159-4520-bf47-6def8899c81f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:05.872463 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-0cc7e34a-8159-4520-bf47-6def8899c81f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 824de352-7b8c-4ab6-8e42-1958f7b70c25] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:05.924154 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-0cc7e34a-8159-4520-bf47-6def8899c81f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:05.931326 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-0cc7e34a-8159-4520-bf47-6def8899c81f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25" status: 200 len: 1218 microversion: 2.1 time: 0.063010 Sep 02 17:10:05.932203 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 134/275] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:05 2021] GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25 => generated 1218 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:06.333136 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-7a3af996-d845-4551-9bfb-73a4a09a346a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:06.334254 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-7a3af996-d845-4551-9bfb-73a4a09a346a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:06.342296 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7a3af996-d845-4551-9bfb-73a4a09a346a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:06.342770 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7a3af996-d845-4551-9bfb-73a4a09a346a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:06.343551 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7a3af996-d845-4551-9bfb-73a4a09a346a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:06.343990 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7a3af996-d845-4551-9bfb-73a4a09a346a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:06.370141 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-9f74acaf-6d67-4074-a881-b9770faa5bde tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:06.371124 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-9f74acaf-6d67-4074-a881-b9770faa5bde tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:06.378266 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9f74acaf-6d67-4074-a881-b9770faa5bde tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:06.378739 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9f74acaf-6d67-4074-a881-b9770faa5bde tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:06.379511 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9f74acaf-6d67-4074-a881-b9770faa5bde tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:06.379946 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9f74acaf-6d67-4074-a881-b9770faa5bde tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:06.517609 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-9f74acaf-6d67-4074-a881-b9770faa5bde tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 22480 microversion: 2.20 time: 0.152233 Sep 02 17:10:06.518485 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 135/276] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:10:06 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 22480 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:10:06.551025 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-306d145a-04bb-4075-b6e5-362b58fccb22 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:06.551713 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-306d145a-04bb-4075-b6e5-362b58fccb22 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 90cb7d6a-93e4-427e-bdba-de422d89fa0f] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:06.558814 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-306d145a-04bb-4075-b6e5-362b58fccb22 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:06.559265 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-306d145a-04bb-4075-b6e5-362b58fccb22 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:06.560027 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-306d145a-04bb-4075-b6e5-362b58fccb22 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:06.560460 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-306d145a-04bb-4075-b6e5-362b58fccb22 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:06.571365 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-7a3af996-d845-4551-9bfb-73a4a09a346a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 20510 microversion: 2.1 time: 0.240983 Sep 02 17:10:06.575022 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 142/277] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:06 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 20510 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:10:06.688106 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-306d145a-04bb-4075-b6e5-362b58fccb22 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:06.696323 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-306d145a-04bb-4075-b6e5-362b58fccb22 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f" status: 200 len: 1319 microversion: 2.1 time: 0.149248 Sep 02 17:10:06.696876 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 136/278] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:06 2021] GET /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:10:06.700666 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-30e4b8a0-6498-45cf-af75-aa36daf50ab9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:06.701639 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-30e4b8a0-6498-45cf-af75-aa36daf50ab9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:06.708114 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-30e4b8a0-6498-45cf-af75-aa36daf50ab9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:06.708556 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-30e4b8a0-6498-45cf-af75-aa36daf50ab9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:06.709316 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-30e4b8a0-6498-45cf-af75-aa36daf50ab9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:06.709740 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-30e4b8a0-6498-45cf-af75-aa36daf50ab9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:06.833436 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-30e4b8a0-6498-45cf-af75-aa36daf50ab9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:06.840741 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-30e4b8a0-6498-45cf-af75-aa36daf50ab9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1522 microversion: 2.1 time: 0.146023 Sep 02 17:10:06.841293 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 143/279] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:06 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:10:06.952540 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-933c1edc-90c6-4b26-978b-0822885da949 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:06.953226 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-933c1edc-90c6-4b26-978b-0822885da949 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 824de352-7b8c-4ab6-8e42-1958f7b70c25] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:06.959212 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-933c1edc-90c6-4b26-978b-0822885da949 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:06.959744 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-933c1edc-90c6-4b26-978b-0822885da949 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:06.960603 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-933c1edc-90c6-4b26-978b-0822885da949 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:06.961093 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-933c1edc-90c6-4b26-978b-0822885da949 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:07.021493 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-933c1edc-90c6-4b26-978b-0822885da949 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:07.029164 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-933c1edc-90c6-4b26-978b-0822885da949 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25" status: 200 len: 1270 microversion: 2.1 time: 0.080662 Sep 02 17:10:07.030341 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 137/280] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:06 2021] GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25 => generated 1270 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:07.529105 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-35d311a1-7f36-4142-985e-d41097594186 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:07.530079 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-35d311a1-7f36-4142-985e-d41097594186 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:07.543988 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-35d311a1-7f36-4142-985e-d41097594186 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:07.543988 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-35d311a1-7f36-4142-985e-d41097594186 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:07.543988 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-35d311a1-7f36-4142-985e-d41097594186 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:07.543988 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-35d311a1-7f36-4142-985e-d41097594186 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:07.583273 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-dcb6faf7-d488-4aac-9a0e-a7d3fa85873b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:07.587286 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-dcb6faf7-d488-4aac-9a0e-a7d3fa85873b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:07.594335 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-dcb6faf7-d488-4aac-9a0e-a7d3fa85873b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:07.594824 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-dcb6faf7-d488-4aac-9a0e-a7d3fa85873b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:07.595606 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-dcb6faf7-d488-4aac-9a0e-a7d3fa85873b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:07.596043 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-dcb6faf7-d488-4aac-9a0e-a7d3fa85873b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:07.706965 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-35d311a1-7f36-4142-985e-d41097594186 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 23215 microversion: 2.20 time: 0.180783 Sep 02 17:10:07.708279 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 144/281] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:10:07 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 23215 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:10:07.714469 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-b398ab0d-dd2c-4468-ae34-8ea855002fda tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:07.717156 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-b398ab0d-dd2c-4468-ae34-8ea855002fda tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 90cb7d6a-93e4-427e-bdba-de422d89fa0f] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:07.729067 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b398ab0d-dd2c-4468-ae34-8ea855002fda tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:07.730203 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b398ab0d-dd2c-4468-ae34-8ea855002fda tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:07.732234 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b398ab0d-dd2c-4468-ae34-8ea855002fda tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:07.732801 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b398ab0d-dd2c-4468-ae34-8ea855002fda tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:07.750665 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-dcb6faf7-d488-4aac-9a0e-a7d3fa85873b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 21989 microversion: 2.1 time: 0.170766 Sep 02 17:10:07.753346 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 138/282] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:07 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 21989 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:10:07.759496 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-8fc93045-16f4-4dc6-9675-1592cfc10bc3 req-e5ceaa4d-df59-4ae3-95c1-187040f27a31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90cb7d6a-93e4-427e-bdba-de422d89fa0f", "name": "network-vif-plugged", "status": "completed", "tag": "e9dda3e8-e3cc-41ac-a8ce-42eacc3fc937"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:07.761995 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:10:07.761995 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:10:07.772207 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-8fc93045-16f4-4dc6-9675-1592cfc10bc3 req-e5ceaa4d-df59-4ae3-95c1-187040f27a31 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:07.772986 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-8fc93045-16f4-4dc6-9675-1592cfc10bc3 req-e5ceaa4d-df59-4ae3-95c1-187040f27a31 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:07.791223 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-8fc93045-16f4-4dc6-9675-1592cfc10bc3 req-e5ceaa4d-df59-4ae3-95c1-187040f27a31 service nova] Creating event network-vif-plugged:e9dda3e8-e3cc-41ac-a8ce-42eacc3fc937 for instance 90cb7d6a-93e4-427e-bdba-de422d89fa0f on hv-cinder-80626 Sep 02 17:10:07.798097 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-8fc93045-16f4-4dc6-9675-1592cfc10bc3 req-e5ceaa4d-df59-4ae3-95c1-187040f27a31 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042767 Sep 02 17:10:07.799604 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 139/283] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:10:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:10:07.860833 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-2616d7aa-5a18-46bf-a4f6-199613727c9a tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:07.862254 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-2616d7aa-5a18-46bf-a4f6-199613727c9a tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:07.872443 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2616d7aa-5a18-46bf-a4f6-199613727c9a tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:07.881749 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2616d7aa-5a18-46bf-a4f6-199613727c9a tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:07.884240 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2616d7aa-5a18-46bf-a4f6-199613727c9a tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:07.884849 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2616d7aa-5a18-46bf-a4f6-199613727c9a tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:08.058549 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-b398ab0d-dd2c-4468-ae34-8ea855002fda tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:08.072090 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-b398ab0d-dd2c-4468-ae34-8ea855002fda tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f" status: 200 len: 1319 microversion: 2.1 time: 0.362330 Sep 02 17:10:08.073117 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 145/284] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:07 2021] GET /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f => generated 1319 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:08.087129 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-26bf8d23-ece5-4260-abca-bb09d8076cf1 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:08.088384 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-26bf8d23-ece5-4260-abca-bb09d8076cf1 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 824de352-7b8c-4ab6-8e42-1958f7b70c25] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:08.095052 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-26bf8d23-ece5-4260-abca-bb09d8076cf1 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:08.095497 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-26bf8d23-ece5-4260-abca-bb09d8076cf1 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:08.096597 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-26bf8d23-ece5-4260-abca-bb09d8076cf1 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:08.097232 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-26bf8d23-ece5-4260-abca-bb09d8076cf1 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:08.279566 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-2616d7aa-5a18-46bf-a4f6-199613727c9a tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:08.293801 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-2616d7aa-5a18-46bf-a4f6-199613727c9a tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1522 microversion: 2.1 time: 0.438504 Sep 02 17:10:08.305022 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-26bf8d23-ece5-4260-abca-bb09d8076cf1 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:08.305689 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 140/285] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:07 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1522 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:08.307451 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-26bf8d23-ece5-4260-abca-bb09d8076cf1 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25" status: 200 len: 1318 microversion: 2.1 time: 0.233192 Sep 02 17:10:08.308258 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 146/286] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:08 2021] GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25 => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:08.720439 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-e9005d08-b080-4921-a109-2f169601971c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:08.722048 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-e9005d08-b080-4921-a109-2f169601971c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:08.732031 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e9005d08-b080-4921-a109-2f169601971c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:08.732474 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e9005d08-b080-4921-a109-2f169601971c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:08.736604 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e9005d08-b080-4921-a109-2f169601971c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:08.737046 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e9005d08-b080-4921-a109-2f169601971c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:08.763844 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-c0ff85f3-4ff2-4670-9cd9-8b445a08c751 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:08.764853 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-c0ff85f3-4ff2-4670-9cd9-8b445a08c751 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:08.795618 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c0ff85f3-4ff2-4670-9cd9-8b445a08c751 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:08.797506 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c0ff85f3-4ff2-4670-9cd9-8b445a08c751 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:08.798550 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c0ff85f3-4ff2-4670-9cd9-8b445a08c751 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:08.800315 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c0ff85f3-4ff2-4670-9cd9-8b445a08c751 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:08.978481 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-c0ff85f3-4ff2-4670-9cd9-8b445a08c751 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 23168 microversion: 2.1 time: 0.218531 Sep 02 17:10:08.982989 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 147/287] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:08 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 23168 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:10:09.009370 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-e9005d08-b080-4921-a109-2f169601971c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 23784 microversion: 2.20 time: 0.293880 Sep 02 17:10:09.010789 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 141/288] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:10:08 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 23784 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:10:09.090111 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-c02feae6-950c-4012-8edf-ef2cf7676db5 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:09.090937 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-c02feae6-950c-4012-8edf-ef2cf7676db5 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 90cb7d6a-93e4-427e-bdba-de422d89fa0f] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:09.097979 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c02feae6-950c-4012-8edf-ef2cf7676db5 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:09.098547 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c02feae6-950c-4012-8edf-ef2cf7676db5 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:09.099453 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c02feae6-950c-4012-8edf-ef2cf7676db5 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:09.099960 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c02feae6-950c-4012-8edf-ef2cf7676db5 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:09.158664 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-020d3035-d947-4da5-935e-4898abd2ccac req-6f560039-982c-4bf9-a155-fe58b13a99f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "824de352-7b8c-4ab6-8e42-1958f7b70c25", "tag": "952e9d68-5d66-4070-8f0d-f97eda69ecab"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:09.160143 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:10:09.160143 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:10:09.171321 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-020d3035-d947-4da5-935e-4898abd2ccac req-6f560039-982c-4bf9-a155-fe58b13a99f9 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:09.172122 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-020d3035-d947-4da5-935e-4898abd2ccac req-6f560039-982c-4bf9-a155-fe58b13a99f9 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:09.188658 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-020d3035-d947-4da5-935e-4898abd2ccac req-6f560039-982c-4bf9-a155-fe58b13a99f9 service nova] Creating event network-changed:952e9d68-5d66-4070-8f0d-f97eda69ecab for instance 824de352-7b8c-4ab6-8e42-1958f7b70c25 on hv-cinder-80626 Sep 02 17:10:09.195006 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-020d3035-d947-4da5-935e-4898abd2ccac req-6f560039-982c-4bf9-a155-fe58b13a99f9 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046966 Sep 02 17:10:09.199941 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 142/289] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:10:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:10:09.305311 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-c02feae6-950c-4012-8edf-ef2cf7676db5 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:09.313408 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-6040b7f8-cfbe-4455-8a5f-eca5df5bd561 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:09.314238 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-6040b7f8-cfbe-4455-8a5f-eca5df5bd561 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:09.318914 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-c02feae6-950c-4012-8edf-ef2cf7676db5 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f" status: 200 len: 1319 microversion: 2.1 time: 0.232903 Sep 02 17:10:09.319738 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 148/290] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:09 2021] GET /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:09.324350 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-d3f0fe1e-ce47-4cfe-aa68-1c8d6b2b092f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:09.325203 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-d3f0fe1e-ce47-4cfe-aa68-1c8d6b2b092f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 824de352-7b8c-4ab6-8e42-1958f7b70c25] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:09.332091 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6040b7f8-cfbe-4455-8a5f-eca5df5bd561 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:09.332605 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6040b7f8-cfbe-4455-8a5f-eca5df5bd561 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:09.333369 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d3f0fe1e-ce47-4cfe-aa68-1c8d6b2b092f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:09.333761 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6040b7f8-cfbe-4455-8a5f-eca5df5bd561 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:09.333871 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d3f0fe1e-ce47-4cfe-aa68-1c8d6b2b092f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:09.334242 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6040b7f8-cfbe-4455-8a5f-eca5df5bd561 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:09.334520 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d3f0fe1e-ce47-4cfe-aa68-1c8d6b2b092f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:09.334989 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d3f0fe1e-ce47-4cfe-aa68-1c8d6b2b092f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:09.484621 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-6040b7f8-cfbe-4455-8a5f-eca5df5bd561 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:09.493212 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-6040b7f8-cfbe-4455-8a5f-eca5df5bd561 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1522 microversion: 2.1 time: 0.184032 Sep 02 17:10:09.502912 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 143/291] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:09 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:10:09.567541 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-d3f0fe1e-ce47-4cfe-aa68-1c8d6b2b092f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:09.576642 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-d3f0fe1e-ce47-4cfe-aa68-1c8d6b2b092f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25" status: 200 len: 1318 microversion: 2.1 time: 0.255697 Sep 02 17:10:09.577210 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 149/292] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:09 2021] GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25 => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:09.990675 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-df02145a-76b1-424d-8522-8367cc01b44e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:09.991585 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-df02145a-76b1-424d-8522-8367cc01b44e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:09.998268 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-df02145a-76b1-424d-8522-8367cc01b44e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:09.998764 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-df02145a-76b1-424d-8522-8367cc01b44e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:09.999531 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-df02145a-76b1-424d-8522-8367cc01b44e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:09.999952 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-df02145a-76b1-424d-8522-8367cc01b44e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:10.021977 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-b91d5938-eeae-47a1-a6ae-53a56c9746bb tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:10.023158 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-b91d5938-eeae-47a1-a6ae-53a56c9746bb tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:10.030546 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b91d5938-eeae-47a1-a6ae-53a56c9746bb tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:10.032250 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b91d5938-eeae-47a1-a6ae-53a56c9746bb tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:10.033342 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b91d5938-eeae-47a1-a6ae-53a56c9746bb tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:10.040706 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b91d5938-eeae-47a1-a6ae-53a56c9746bb tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:10.214349 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-df02145a-76b1-424d-8522-8367cc01b44e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 23871 microversion: 2.1 time: 0.227215 Sep 02 17:10:10.221019 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 144/293] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:09 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 23871 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:10:10.306034 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-b91d5938-eeae-47a1-a6ae-53a56c9746bb tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 24771 microversion: 2.20 time: 0.287358 Sep 02 17:10:10.307369 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 150/294] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:10:10 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 24771 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:10:10.336378 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-69d64121-5df0-4892-ba7f-0855af2def29 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:10.337109 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-69d64121-5df0-4892-ba7f-0855af2def29 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 90cb7d6a-93e4-427e-bdba-de422d89fa0f] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:10.345777 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-69d64121-5df0-4892-ba7f-0855af2def29 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:10.346219 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-69d64121-5df0-4892-ba7f-0855af2def29 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:10.347244 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-69d64121-5df0-4892-ba7f-0855af2def29 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:10.347847 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-69d64121-5df0-4892-ba7f-0855af2def29 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:10.510945 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-f38d0957-ada0-43e1-a3ea-ccc1f907c407 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:10.511939 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-f38d0957-ada0-43e1-a3ea-ccc1f907c407 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:10.521377 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f38d0957-ada0-43e1-a3ea-ccc1f907c407 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:10.522080 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f38d0957-ada0-43e1-a3ea-ccc1f907c407 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:10.524362 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f38d0957-ada0-43e1-a3ea-ccc1f907c407 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:10.525033 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f38d0957-ada0-43e1-a3ea-ccc1f907c407 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:10.717143 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-69d64121-5df0-4892-ba7f-0855af2def29 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:10.725177 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-69d64121-5df0-4892-ba7f-0855af2def29 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f" status: 200 len: 1507 microversion: 2.1 time: 0.393565 Sep 02 17:10:10.726306 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 145/295] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:10 2021] GET /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f => generated 1507 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:10:10.731712 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-dda688e9-1c75-4ff1-a889-32a18dd20c64 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:10.732553 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-dda688e9-1c75-4ff1-a889-32a18dd20c64 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 824de352-7b8c-4ab6-8e42-1958f7b70c25] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:10.752636 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-dda688e9-1c75-4ff1-a889-32a18dd20c64 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:10.753657 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-dda688e9-1c75-4ff1-a889-32a18dd20c64 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:10.755255 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-dda688e9-1c75-4ff1-a889-32a18dd20c64 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:10.755762 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-dda688e9-1c75-4ff1-a889-32a18dd20c64 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:10.815948 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-f38d0957-ada0-43e1-a3ea-ccc1f907c407 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:10.845034 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-f38d0957-ada0-43e1-a3ea-ccc1f907c407 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1522 microversion: 2.1 time: 0.335912 Sep 02 17:10:10.845901 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 151/296] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:10 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1522 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:10.967202 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-dda688e9-1c75-4ff1-a889-32a18dd20c64 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:10.978158 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-dda688e9-1c75-4ff1-a889-32a18dd20c64 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25" status: 200 len: 1318 microversion: 2.1 time: 0.250156 Sep 02 17:10:10.988448 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 146/297] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:10 2021] GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25 => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:11.228575 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-e3d30768-6f65-4499-bab3-eed016a666a1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:11.230158 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-e3d30768-6f65-4499-bab3-eed016a666a1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:11.236759 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e3d30768-6f65-4499-bab3-eed016a666a1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:11.237447 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e3d30768-6f65-4499-bab3-eed016a666a1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:11.238392 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e3d30768-6f65-4499-bab3-eed016a666a1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:11.239199 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e3d30768-6f65-4499-bab3-eed016a666a1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:11.321447 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-84a98c1a-03a6-4391-8124-f5a68439ea54 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:11.323108 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-84a98c1a-03a6-4391-8124-f5a68439ea54 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:11.337875 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-84a98c1a-03a6-4391-8124-f5a68439ea54 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:11.338560 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-84a98c1a-03a6-4391-8124-f5a68439ea54 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:11.339893 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-84a98c1a-03a6-4391-8124-f5a68439ea54 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:11.340540 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-84a98c1a-03a6-4391-8124-f5a68439ea54 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:11.428786 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-e3d30768-6f65-4499-bab3-eed016a666a1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 24666 microversion: 2.1 time: 0.203696 Sep 02 17:10:11.433501 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 152/298] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:11 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 24666 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:10:11.527135 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-84a98c1a-03a6-4391-8124-f5a68439ea54 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 25643 microversion: 2.20 time: 0.211303 Sep 02 17:10:11.528082 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 147/299] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:10:11 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 25643 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:10:11.862607 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-99935ee3-c46e-4841-b9ec-f6453b6760ef tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:11.863375 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-99935ee3-c46e-4841-b9ec-f6453b6760ef tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:11.872423 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-99935ee3-c46e-4841-b9ec-f6453b6760ef tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:11.872777 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-99935ee3-c46e-4841-b9ec-f6453b6760ef tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:11.873725 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-99935ee3-c46e-4841-b9ec-f6453b6760ef tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:11.874157 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-99935ee3-c46e-4841-b9ec-f6453b6760ef tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:11.997037 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-16abf272-241b-40f0-8981-d6144ea6ec90 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:11.997926 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-16abf272-241b-40f0-8981-d6144ea6ec90 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 824de352-7b8c-4ab6-8e42-1958f7b70c25] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:12.007047 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-16abf272-241b-40f0-8981-d6144ea6ec90 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:12.007870 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-16abf272-241b-40f0-8981-d6144ea6ec90 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:12.008852 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-16abf272-241b-40f0-8981-d6144ea6ec90 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:12.009384 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-16abf272-241b-40f0-8981-d6144ea6ec90 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:12.011277 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-99935ee3-c46e-4841-b9ec-f6453b6760ef tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:12.021816 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-99935ee3-c46e-4841-b9ec-f6453b6760ef tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1522 microversion: 2.1 time: 0.163096 Sep 02 17:10:12.022516 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 153/300] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:11 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:12.145011 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-16abf272-241b-40f0-8981-d6144ea6ec90 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:12.152852 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-16abf272-241b-40f0-8981-d6144ea6ec90 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25" status: 200 len: 1318 microversion: 2.1 time: 0.161502 Sep 02 17:10:12.153412 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 148/301] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:11 2021] GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:10:12.441127 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-83ff9b96-683a-4bfc-b760-f899ef792495 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:12.442739 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-83ff9b96-683a-4bfc-b760-f899ef792495 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:12.450060 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-83ff9b96-683a-4bfc-b760-f899ef792495 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:12.450714 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-83ff9b96-683a-4bfc-b760-f899ef792495 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:12.451497 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-83ff9b96-683a-4bfc-b760-f899ef792495 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:12.452087 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-83ff9b96-683a-4bfc-b760-f899ef792495 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:12.540736 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-fb3aca1e-a938-493f-bab4-0ac058ea5070 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:12.541688 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-fb3aca1e-a938-493f-bab4-0ac058ea5070 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:12.548559 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fb3aca1e-a938-493f-bab4-0ac058ea5070 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:12.549086 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fb3aca1e-a938-493f-bab4-0ac058ea5070 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:12.549983 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fb3aca1e-a938-493f-bab4-0ac058ea5070 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:12.550524 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fb3aca1e-a938-493f-bab4-0ac058ea5070 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:12.584174 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-83ff9b96-683a-4bfc-b760-f899ef792495 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 25534 microversion: 2.1 time: 0.146535 Sep 02 17:10:12.585079 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 154/302] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:12 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 25534 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:10:12.683625 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-fb3aca1e-a938-493f-bab4-0ac058ea5070 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 26229 microversion: 2.20 time: 0.147494 Sep 02 17:10:12.689365 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 149/303] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:10:12 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 26229 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:10:13.042346 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-2b767c83-268d-4e45-a53e-19e1d3aa4b1a tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:13.043090 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-2b767c83-268d-4e45-a53e-19e1d3aa4b1a tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:13.049737 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2b767c83-268d-4e45-a53e-19e1d3aa4b1a tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:13.050471 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2b767c83-268d-4e45-a53e-19e1d3aa4b1a tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:13.051284 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2b767c83-268d-4e45-a53e-19e1d3aa4b1a tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:13.051717 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2b767c83-268d-4e45-a53e-19e1d3aa4b1a tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:13.169904 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-77a63221-2b80-411f-bac9-89ff6cbbfbf6 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:13.171800 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-77a63221-2b80-411f-bac9-89ff6cbbfbf6 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 824de352-7b8c-4ab6-8e42-1958f7b70c25] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:13.180852 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-77a63221-2b80-411f-bac9-89ff6cbbfbf6 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:13.180852 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-77a63221-2b80-411f-bac9-89ff6cbbfbf6 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:13.180852 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-77a63221-2b80-411f-bac9-89ff6cbbfbf6 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:13.180852 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-77a63221-2b80-411f-bac9-89ff6cbbfbf6 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:13.241617 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-2b767c83-268d-4e45-a53e-19e1d3aa4b1a tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:13.249100 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-2b767c83-268d-4e45-a53e-19e1d3aa4b1a tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1522 microversion: 2.1 time: 0.214024 Sep 02 17:10:13.249657 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 155/304] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:13 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:10:13.326837 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-77a63221-2b80-411f-bac9-89ff6cbbfbf6 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:13.334115 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-77a63221-2b80-411f-bac9-89ff6cbbfbf6 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25" status: 200 len: 1318 microversion: 2.1 time: 0.168652 Sep 02 17:10:13.334705 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 150/305] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:13 2021] GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:10:13.597027 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-4a002740-8096-4b03-bf24-e327514a8d83 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:13.598272 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-4a002740-8096-4b03-bf24-e327514a8d83 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:13.604231 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4a002740-8096-4b03-bf24-e327514a8d83 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:13.604793 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4a002740-8096-4b03-bf24-e327514a8d83 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:13.605677 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4a002740-8096-4b03-bf24-e327514a8d83 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:13.606285 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4a002740-8096-4b03-bf24-e327514a8d83 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:13.696310 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-c896818e-7879-44a5-8b56-dda25a540d80 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:13.697624 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-c896818e-7879-44a5-8b56-dda25a540d80 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:13.703162 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c896818e-7879-44a5-8b56-dda25a540d80 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:13.703353 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c896818e-7879-44a5-8b56-dda25a540d80 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:13.704303 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c896818e-7879-44a5-8b56-dda25a540d80 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:13.704764 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c896818e-7879-44a5-8b56-dda25a540d80 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:13.718372 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-4a002740-8096-4b03-bf24-e327514a8d83 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 26218 microversion: 2.1 time: 0.125079 Sep 02 17:10:13.719245 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 156/306] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:13 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 26218 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:10:13.859630 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-c896818e-7879-44a5-8b56-dda25a540d80 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 26915 microversion: 2.20 time: 0.166517 Sep 02 17:10:13.860272 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 151/307] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:10:13 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 26915 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:10:14.270925 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-a7a0dcf1-f467-426a-8669-a3e52cd6b56c tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:14.271802 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-a7a0dcf1-f467-426a-8669-a3e52cd6b56c tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:14.283917 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a7a0dcf1-f467-426a-8669-a3e52cd6b56c tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:14.287771 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a7a0dcf1-f467-426a-8669-a3e52cd6b56c tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:14.295960 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a7a0dcf1-f467-426a-8669-a3e52cd6b56c tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:14.296833 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a7a0dcf1-f467-426a-8669-a3e52cd6b56c tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:14.353024 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-41eadfd9-5fa5-43f4-97c9-258a0059c3e1 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:14.354880 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-41eadfd9-5fa5-43f4-97c9-258a0059c3e1 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 824de352-7b8c-4ab6-8e42-1958f7b70c25] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:14.363196 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-41eadfd9-5fa5-43f4-97c9-258a0059c3e1 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:14.364918 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-41eadfd9-5fa5-43f4-97c9-258a0059c3e1 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:14.371822 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-41eadfd9-5fa5-43f4-97c9-258a0059c3e1 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:14.372279 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-41eadfd9-5fa5-43f4-97c9-258a0059c3e1 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:14.480080 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-a7a0dcf1-f467-426a-8669-a3e52cd6b56c tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:14.489338 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-a7a0dcf1-f467-426a-8669-a3e52cd6b56c tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1522 microversion: 2.1 time: 0.223959 Sep 02 17:10:14.489898 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 157/308] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:14 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:14.614435 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-41eadfd9-5fa5-43f4-97c9-258a0059c3e1 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:14.623067 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-41eadfd9-5fa5-43f4-97c9-258a0059c3e1 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25" status: 200 len: 1318 microversion: 2.1 time: 0.275802 Sep 02 17:10:14.632127 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 152/309] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:14 2021] GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25 => generated 1318 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:14.730070 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-323fe2f6-e7ec-4361-80c0-481b49d027fd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:14.730950 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-323fe2f6-e7ec-4361-80c0-481b49d027fd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:14.737166 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-323fe2f6-e7ec-4361-80c0-481b49d027fd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:14.737610 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-323fe2f6-e7ec-4361-80c0-481b49d027fd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:14.738390 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-323fe2f6-e7ec-4361-80c0-481b49d027fd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:14.738857 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-323fe2f6-e7ec-4361-80c0-481b49d027fd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:14.875034 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-b35d1234-8691-4671-b39f-a57cfb05b52e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:14.875478 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-b35d1234-8691-4671-b39f-a57cfb05b52e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:14.881930 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b35d1234-8691-4671-b39f-a57cfb05b52e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:14.883056 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b35d1234-8691-4671-b39f-a57cfb05b52e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:14.883872 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b35d1234-8691-4671-b39f-a57cfb05b52e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:14.884307 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b35d1234-8691-4671-b39f-a57cfb05b52e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:14.886693 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-323fe2f6-e7ec-4361-80c0-481b49d027fd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 26736 microversion: 2.1 time: 0.160049 Sep 02 17:10:14.886693 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 158/310] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:14 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 26736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:10:15.024337 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-b35d1234-8691-4671-b39f-a57cfb05b52e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 27254 microversion: 2.20 time: 0.154328 Sep 02 17:10:15.025427 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 153/311] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:10:14 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 27254 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:10:15.507007 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-fbf40d0e-bdae-4e7b-a701-7b74df925640 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:15.508338 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-fbf40d0e-bdae-4e7b-a701-7b74df925640 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:15.515017 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fbf40d0e-bdae-4e7b-a701-7b74df925640 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:15.515467 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fbf40d0e-bdae-4e7b-a701-7b74df925640 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:15.516243 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fbf40d0e-bdae-4e7b-a701-7b74df925640 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:15.518000 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fbf40d0e-bdae-4e7b-a701-7b74df925640 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:15.640092 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-f4fae276-e0b4-428a-84d4-2e4f27e12841 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:15.641037 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-f4fae276-e0b4-428a-84d4-2e4f27e12841 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 824de352-7b8c-4ab6-8e42-1958f7b70c25] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:15.649548 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f4fae276-e0b4-428a-84d4-2e4f27e12841 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:15.650201 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f4fae276-e0b4-428a-84d4-2e4f27e12841 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:15.651458 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f4fae276-e0b4-428a-84d4-2e4f27e12841 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:15.652142 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f4fae276-e0b4-428a-84d4-2e4f27e12841 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:15.686892 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-fbf40d0e-bdae-4e7b-a701-7b74df925640 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:15.694910 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-fbf40d0e-bdae-4e7b-a701-7b74df925640 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1522 microversion: 2.1 time: 0.191834 Sep 02 17:10:15.696374 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 159/312] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:15 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:15.845174 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-f4fae276-e0b4-428a-84d4-2e4f27e12841 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:15.853605 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-f4fae276-e0b4-428a-84d4-2e4f27e12841 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25" status: 200 len: 1318 microversion: 2.1 time: 0.218208 Sep 02 17:10:15.854270 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 154/313] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:15 2021] GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25 => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:10:15.898594 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-be8d8b14-956d-4f78-834d-ecd3168400cf tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:15.899544 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-be8d8b14-956d-4f78-834d-ecd3168400cf tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:15.907714 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-be8d8b14-956d-4f78-834d-ecd3168400cf tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:15.908379 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-be8d8b14-956d-4f78-834d-ecd3168400cf tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:15.909225 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-be8d8b14-956d-4f78-834d-ecd3168400cf tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:15.909669 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-be8d8b14-956d-4f78-834d-ecd3168400cf tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:16.036264 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-e1def53c-a354-4a8f-b701-bb72927f6165 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:16.037163 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-e1def53c-a354-4a8f-b701-bb72927f6165 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:16.045659 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-be8d8b14-956d-4f78-834d-ecd3168400cf tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 27111 microversion: 2.1 time: 0.151832 Sep 02 17:10:16.046537 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 160/314] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:15 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 27111 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:10:16.051532 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e1def53c-a354-4a8f-b701-bb72927f6165 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:16.052079 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e1def53c-a354-4a8f-b701-bb72927f6165 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:16.052802 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e1def53c-a354-4a8f-b701-bb72927f6165 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:16.053293 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e1def53c-a354-4a8f-b701-bb72927f6165 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:16.190557 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-e1def53c-a354-4a8f-b701-bb72927f6165 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 27545 microversion: 2.20 time: 0.158076 Sep 02 17:10:16.191449 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 155/315] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:10:16 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 27545 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:10:16.714109 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-1c5ea9e9-148d-47f8-a014-4954729efd8e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:16.715185 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-1c5ea9e9-148d-47f8-a014-4954729efd8e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:16.722646 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1c5ea9e9-148d-47f8-a014-4954729efd8e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:16.723477 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1c5ea9e9-148d-47f8-a014-4954729efd8e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:16.724250 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1c5ea9e9-148d-47f8-a014-4954729efd8e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:16.724838 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1c5ea9e9-148d-47f8-a014-4954729efd8e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:16.862932 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-1c5ea9e9-148d-47f8-a014-4954729efd8e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:16.872809 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-1c5ea9e9-148d-47f8-a014-4954729efd8e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1522 microversion: 2.1 time: 0.164078 Sep 02 17:10:16.873581 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 161/316] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:16 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:16.873714 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-564f3959-89c7-49bd-a03a-aa5a854e7a87 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:16.874589 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-564f3959-89c7-49bd-a03a-aa5a854e7a87 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 824de352-7b8c-4ab6-8e42-1958f7b70c25] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:16.883457 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-564f3959-89c7-49bd-a03a-aa5a854e7a87 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:16.884330 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-564f3959-89c7-49bd-a03a-aa5a854e7a87 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:16.885440 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-564f3959-89c7-49bd-a03a-aa5a854e7a87 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:16.886043 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-564f3959-89c7-49bd-a03a-aa5a854e7a87 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:17.040046 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-564f3959-89c7-49bd-a03a-aa5a854e7a87 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:17.056932 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-564f3959-89c7-49bd-a03a-aa5a854e7a87 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25" status: 200 len: 1318 microversion: 2.1 time: 0.188544 Sep 02 17:10:17.057509 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 156/317] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:16 2021] GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25 => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:10:17.058679 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-c2df4b18-96d8-4420-988b-9c3989f43d72 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:17.061000 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-c2df4b18-96d8-4420-988b-9c3989f43d72 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:17.070386 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c2df4b18-96d8-4420-988b-9c3989f43d72 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:17.071085 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c2df4b18-96d8-4420-988b-9c3989f43d72 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:17.071910 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c2df4b18-96d8-4420-988b-9c3989f43d72 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:17.072347 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c2df4b18-96d8-4420-988b-9c3989f43d72 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:17.203409 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-0c5979ef-d1b9-4768-a75b-4c68b5059a5f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:17.204320 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-0c5979ef-d1b9-4768-a75b-4c68b5059a5f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:17.210971 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-0c5979ef-d1b9-4768-a75b-4c68b5059a5f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:17.211573 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-0c5979ef-d1b9-4768-a75b-4c68b5059a5f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:17.212623 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-0c5979ef-d1b9-4768-a75b-4c68b5059a5f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:17.213065 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-0c5979ef-d1b9-4768-a75b-4c68b5059a5f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:17.268579 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-c2df4b18-96d8-4420-988b-9c3989f43d72 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 27659 microversion: 2.1 time: 0.214293 Sep 02 17:10:17.269542 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 162/318] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:17 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 27659 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:10:17.356434 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-0c5979ef-d1b9-4768-a75b-4c68b5059a5f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 27782 microversion: 2.20 time: 0.156712 Sep 02 17:10:17.360310 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 157/319] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:10:17 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 27782 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:10:17.737901 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [req-c42c7673-0130-4e21-972e-102a3102fe89 req-d683bfb4-cdcd-415f-81d7-27b0794abdd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "824de352-7b8c-4ab6-8e42-1958f7b70c25", "name": "network-vif-plugged", "status": "completed", "tag": "952e9d68-5d66-4070-8f0d-f97eda69ecab"}]} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:17.739459 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:10:17.739459 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: warnings.warn(msg) Sep 02 17:10:17.747325 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-c42c7673-0130-4e21-972e-102a3102fe89 req-d683bfb4-cdcd-415f-81d7-27b0794abdd4 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:17.747767 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-c42c7673-0130-4e21-972e-102a3102fe89 req-d683bfb4-cdcd-415f-81d7-27b0794abdd4 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:17.762294 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.compute.server_external_events [req-c42c7673-0130-4e21-972e-102a3102fe89 req-d683bfb4-cdcd-415f-81d7-27b0794abdd4 service nova] Creating event network-vif-plugged:952e9d68-5d66-4070-8f0d-f97eda69ecab for instance 824de352-7b8c-4ab6-8e42-1958f7b70c25 on hv-cinder-80626 Sep 02 17:10:17.767125 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [req-c42c7673-0130-4e21-972e-102a3102fe89 req-d683bfb4-cdcd-415f-81d7-27b0794abdd4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033350 Sep 02 17:10:17.768036 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 163/320] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:10:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:10:17.890012 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-c5e8e05a-b52f-4f8f-a4ec-13e81138d8ae tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:17.890830 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-c5e8e05a-b52f-4f8f-a4ec-13e81138d8ae tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:17.904671 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c5e8e05a-b52f-4f8f-a4ec-13e81138d8ae tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:17.905133 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c5e8e05a-b52f-4f8f-a4ec-13e81138d8ae tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:17.905916 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c5e8e05a-b52f-4f8f-a4ec-13e81138d8ae tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:17.906505 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c5e8e05a-b52f-4f8f-a4ec-13e81138d8ae tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:18.074666 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-14ad15a8-f743-4b24-920f-fd16e7c625a3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:18.076179 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-14ad15a8-f743-4b24-920f-fd16e7c625a3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 824de352-7b8c-4ab6-8e42-1958f7b70c25] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:18.082903 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-14ad15a8-f743-4b24-920f-fd16e7c625a3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:18.083352 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-14ad15a8-f743-4b24-920f-fd16e7c625a3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:18.084138 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-14ad15a8-f743-4b24-920f-fd16e7c625a3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:18.084572 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-14ad15a8-f743-4b24-920f-fd16e7c625a3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:18.201923 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-c5e8e05a-b52f-4f8f-a4ec-13e81138d8ae tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:18.210358 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-c5e8e05a-b52f-4f8f-a4ec-13e81138d8ae tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1522 microversion: 2.1 time: 0.324286 Sep 02 17:10:18.213349 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 158/321] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:17 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1522 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:18.235098 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-14ad15a8-f743-4b24-920f-fd16e7c625a3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:18.243314 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-14ad15a8-f743-4b24-920f-fd16e7c625a3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25" status: 200 len: 1318 microversion: 2.1 time: 0.173556 Sep 02 17:10:18.243875 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 164/322] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:18 2021] GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:10:18.280872 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-f6afef3f-eab8-4968-b7bb-a0735fa3c0c6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:18.281908 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-f6afef3f-eab8-4968-b7bb-a0735fa3c0c6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:18.287778 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f6afef3f-eab8-4968-b7bb-a0735fa3c0c6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:18.288217 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f6afef3f-eab8-4968-b7bb-a0735fa3c0c6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:18.289544 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f6afef3f-eab8-4968-b7bb-a0735fa3c0c6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:18.289969 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f6afef3f-eab8-4968-b7bb-a0735fa3c0c6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:18.368515 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-cbf9307e-bde9-4be0-8cf4-f1ba534d76dc tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:18.369417 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-cbf9307e-bde9-4be0-8cf4-f1ba534d76dc tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:18.375471 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-cbf9307e-bde9-4be0-8cf4-f1ba534d76dc tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:18.375960 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-cbf9307e-bde9-4be0-8cf4-f1ba534d76dc tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:18.377070 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-cbf9307e-bde9-4be0-8cf4-f1ba534d76dc tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:18.377582 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-cbf9307e-bde9-4be0-8cf4-f1ba534d76dc tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:18.705725 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-f6afef3f-eab8-4968-b7bb-a0735fa3c0c6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 27839 microversion: 2.1 time: 0.428110 Sep 02 17:10:18.710072 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 159/323] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:18 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 27839 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:10:18.736905 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-cbf9307e-bde9-4be0-8cf4-f1ba534d76dc tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 28134 microversion: 2.20 time: 0.372427 Sep 02 17:10:18.737560 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 165/324] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:10:18 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 28134 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:10:19.232256 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-da3dbdf3-bc63-4213-ad34-607bf5e7924c tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:19.233835 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-da3dbdf3-bc63-4213-ad34-607bf5e7924c tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:19.241527 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-da3dbdf3-bc63-4213-ad34-607bf5e7924c tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:19.242167 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-da3dbdf3-bc63-4213-ad34-607bf5e7924c tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:19.243108 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-da3dbdf3-bc63-4213-ad34-607bf5e7924c tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:19.243519 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-da3dbdf3-bc63-4213-ad34-607bf5e7924c tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:19.262567 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-7781bca5-19e0-42a6-9c79-b9615318c1b3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:19.263947 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-7781bca5-19e0-42a6-9c79-b9615318c1b3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 824de352-7b8c-4ab6-8e42-1958f7b70c25] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:19.271596 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7781bca5-19e0-42a6-9c79-b9615318c1b3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:19.272160 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7781bca5-19e0-42a6-9c79-b9615318c1b3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:19.273644 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7781bca5-19e0-42a6-9c79-b9615318c1b3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:19.274568 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7781bca5-19e0-42a6-9c79-b9615318c1b3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:19.371755 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-da3dbdf3-bc63-4213-ad34-607bf5e7924c tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:19.379076 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-da3dbdf3-bc63-4213-ad34-607bf5e7924c tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1522 microversion: 2.1 time: 0.152575 Sep 02 17:10:19.379631 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 160/325] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:19 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:19.400920 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-7781bca5-19e0-42a6-9c79-b9615318c1b3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:19.408286 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-7781bca5-19e0-42a6-9c79-b9615318c1b3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25" status: 200 len: 1318 microversion: 2.1 time: 0.152150 Sep 02 17:10:19.408852 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 166/326] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:19 2021] GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:10:19.727993 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-e59b7dca-2086-4cdf-a304-adbf33631fad tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:19.729417 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-e59b7dca-2086-4cdf-a304-adbf33631fad tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:19.736147 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e59b7dca-2086-4cdf-a304-adbf33631fad tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:19.736599 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e59b7dca-2086-4cdf-a304-adbf33631fad tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:19.737382 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e59b7dca-2086-4cdf-a304-adbf33631fad tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:19.737814 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e59b7dca-2086-4cdf-a304-adbf33631fad tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:19.749064 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-19a3637a-7b65-4e2d-a28e-ec11e1e070f7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:19.750228 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-19a3637a-7b65-4e2d-a28e-ec11e1e070f7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:19.756591 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-19a3637a-7b65-4e2d-a28e-ec11e1e070f7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:19.757079 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-19a3637a-7b65-4e2d-a28e-ec11e1e070f7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:19.758011 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-19a3637a-7b65-4e2d-a28e-ec11e1e070f7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:19.758472 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-19a3637a-7b65-4e2d-a28e-ec11e1e070f7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:22.769957 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-e59b7dca-2086-4cdf-a304-adbf33631fad tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 28191 microversion: 2.1 time: 3.056175 Sep 02 17:10:22.774402 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 161/327] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:19 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 28191 bytes in 3058 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:10:22.775955 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-0187a55e-6371-4325-b580-51e4fffb38a3 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:22.776743 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-0187a55e-6371-4325-b580-51e4fffb38a3 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:22.783571 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-0187a55e-6371-4325-b580-51e4fffb38a3 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:22.784025 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-0187a55e-6371-4325-b580-51e4fffb38a3 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:22.784803 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-0187a55e-6371-4325-b580-51e4fffb38a3 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:22.785221 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-0187a55e-6371-4325-b580-51e4fffb38a3 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:22.812783 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-19a3637a-7b65-4e2d-a28e-ec11e1e070f7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 28134 microversion: 2.20 time: 3.067277 Sep 02 17:10:22.816671 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 167/328] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:10:19 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 28134 bytes in 3069 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:10:22.818506 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-54c60f82-5613-4889-bc49-401dd82a6e9f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:22.819260 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-54c60f82-5613-4889-bc49-401dd82a6e9f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 824de352-7b8c-4ab6-8e42-1958f7b70c25] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:22.826021 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-54c60f82-5613-4889-bc49-401dd82a6e9f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:22.826468 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-54c60f82-5613-4889-bc49-401dd82a6e9f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:22.827293 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-54c60f82-5613-4889-bc49-401dd82a6e9f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:22.827729 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-54c60f82-5613-4889-bc49-401dd82a6e9f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:22.916334 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-0187a55e-6371-4325-b580-51e4fffb38a3 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:22.924021 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-0187a55e-6371-4325-b580-51e4fffb38a3 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1522 microversion: 2.1 time: 0.151901 Sep 02 17:10:22.924590 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 162/329] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:22 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:22.957522 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-54c60f82-5613-4889-bc49-401dd82a6e9f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:22.965796 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-54c60f82-5613-4889-bc49-401dd82a6e9f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25" status: 200 len: 1318 microversion: 2.1 time: 0.150867 Sep 02 17:10:22.966336 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 168/330] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:22 2021] GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:23.781257 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-5309c3ef-a99e-4ff6-8017-ce9f1b2cd832 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:23.782166 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-5309c3ef-a99e-4ff6-8017-ce9f1b2cd832 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:23.788423 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5309c3ef-a99e-4ff6-8017-ce9f1b2cd832 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:23.788872 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5309c3ef-a99e-4ff6-8017-ce9f1b2cd832 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:23.789631 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5309c3ef-a99e-4ff6-8017-ce9f1b2cd832 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:23.790055 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5309c3ef-a99e-4ff6-8017-ce9f1b2cd832 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:23.831468 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-9f978425-97e5-4ea0-a6c9-6480768060c1 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:23.831468 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-9f978425-97e5-4ea0-a6c9-6480768060c1 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:23.833806 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9f978425-97e5-4ea0-a6c9-6480768060c1 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:23.834321 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9f978425-97e5-4ea0-a6c9-6480768060c1 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:23.834986 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9f978425-97e5-4ea0-a6c9-6480768060c1 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:23.835414 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9f978425-97e5-4ea0-a6c9-6480768060c1 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:23.937061 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-5309c3ef-a99e-4ff6-8017-ce9f1b2cd832 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 28191 microversion: 2.1 time: 0.159027 Sep 02 17:10:23.944323 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 163/331] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:23 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 28191 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:10:23.950481 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-ac55ec74-27e3-4d54-970e-d6a400a30a8a tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:23.951162 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-ac55ec74-27e3-4d54-970e-d6a400a30a8a tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:23.957979 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ac55ec74-27e3-4d54-970e-d6a400a30a8a tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:23.958548 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ac55ec74-27e3-4d54-970e-d6a400a30a8a tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:23.959383 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ac55ec74-27e3-4d54-970e-d6a400a30a8a tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:23.959813 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ac55ec74-27e3-4d54-970e-d6a400a30a8a tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:23.970110 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-9f978425-97e5-4ea0-a6c9-6480768060c1 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 28134 microversion: 2.20 time: 0.148276 Sep 02 17:10:23.974160 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 169/332] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:10:23 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 28134 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:10:23.982757 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-e55c5b39-bf52-45b1-aee0-bb7293449cb2 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:23.983454 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-e55c5b39-bf52-45b1-aee0-bb7293449cb2 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 824de352-7b8c-4ab6-8e42-1958f7b70c25] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:23.990365 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e55c5b39-bf52-45b1-aee0-bb7293449cb2 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:23.990855 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e55c5b39-bf52-45b1-aee0-bb7293449cb2 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:23.992180 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e55c5b39-bf52-45b1-aee0-bb7293449cb2 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:23.992650 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e55c5b39-bf52-45b1-aee0-bb7293449cb2 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:24.128324 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-ac55ec74-27e3-4d54-970e-d6a400a30a8a tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:24.136975 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-e55c5b39-bf52-45b1-aee0-bb7293449cb2 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:24.137507 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-ac55ec74-27e3-4d54-970e-d6a400a30a8a tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1502 microversion: 2.1 time: 0.190940 Sep 02 17:10:24.138074 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 164/333] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:23 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1502 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:24.144534 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-e55c5b39-bf52-45b1-aee0-bb7293449cb2 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25" status: 200 len: 1508 microversion: 2.1 time: 0.165986 Sep 02 17:10:24.145168 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 170/334] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:23 2021] GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25 => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:10:24.153598 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-e7196c1a-f908-41ff-bbee-bd86901024ae tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:24.154201 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-e7196c1a-f908-41ff-bbee-bd86901024ae tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:24.161615 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e7196c1a-f908-41ff-bbee-bd86901024ae tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:24.162009 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e7196c1a-f908-41ff-bbee-bd86901024ae tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:24.162875 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e7196c1a-f908-41ff-bbee-bd86901024ae tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:24.163314 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e7196c1a-f908-41ff-bbee-bd86901024ae tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:24.311967 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-e7196c1a-f908-41ff-bbee-bd86901024ae tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:24.321225 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-e7196c1a-f908-41ff-bbee-bd86901024ae tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1516 microversion: 2.1 time: 0.171463 Sep 02 17:10:24.321875 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 165/335] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:24 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1516 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:24.948869 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-2d51e22a-d95b-4717-a45c-cfeacbcc27e5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:24.949774 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-2d51e22a-d95b-4717-a45c-cfeacbcc27e5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:24.955723 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2d51e22a-d95b-4717-a45c-cfeacbcc27e5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:24.956165 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2d51e22a-d95b-4717-a45c-cfeacbcc27e5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:24.957034 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2d51e22a-d95b-4717-a45c-cfeacbcc27e5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:24.957334 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2d51e22a-d95b-4717-a45c-cfeacbcc27e5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:24.981798 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-083cf0cd-9c9d-4011-bd3f-4b4a5c0cfa49 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:24.983464 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-083cf0cd-9c9d-4011-bd3f-4b4a5c0cfa49 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:24.993446 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-083cf0cd-9c9d-4011-bd3f-4b4a5c0cfa49 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:24.993446 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-083cf0cd-9c9d-4011-bd3f-4b4a5c0cfa49 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:24.993446 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-083cf0cd-9c9d-4011-bd3f-4b4a5c0cfa49 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:24.993446 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-083cf0cd-9c9d-4011-bd3f-4b4a5c0cfa49 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:28.055744 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-2d51e22a-d95b-4717-a45c-cfeacbcc27e5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 28191 microversion: 2.1 time: 3.110312 Sep 02 17:10:28.056390 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 171/336] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:24 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 28191 bytes in 3112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:10:28.093305 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-083cf0cd-9c9d-4011-bd3f-4b4a5c0cfa49 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 28134 microversion: 2.20 time: 3.115126 Sep 02 17:10:28.093976 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 166/337] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:10:24 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 28134 bytes in 3117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:10:28.976406 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-5a45d1e4-491c-4804-afd5-6295f4ff7fdd tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:28.977356 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-5a45d1e4-491c-4804-afd5-6295f4ff7fdd tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:28.983817 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5a45d1e4-491c-4804-afd5-6295f4ff7fdd tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:28.984263 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5a45d1e4-491c-4804-afd5-6295f4ff7fdd tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:28.985021 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5a45d1e4-491c-4804-afd5-6295f4ff7fdd tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:28.985452 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5a45d1e4-491c-4804-afd5-6295f4ff7fdd tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:29.009217 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.objects.instance [None req-5a45d1e4-491c-4804-afd5-6295f4ff7fdd tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lazy-loading 'flavor' on Instance uuid 089cf4bd-25a6-4572-a20b-99c71430e5f8 {{(pid=108417) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 17:10:29.068327 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-d337974e-45b0-42b1-88da-969d40125a51 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:29.069442 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-d337974e-45b0-42b1-88da-969d40125a51 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:29.076743 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d337974e-45b0-42b1-88da-969d40125a51 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:29.077318 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d337974e-45b0-42b1-88da-969d40125a51 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:29.078268 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d337974e-45b0-42b1-88da-969d40125a51 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:29.078716 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d337974e-45b0-42b1-88da-969d40125a51 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:29.084508 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-5a45d1e4-491c-4804-afd5-6295f4ff7fdd tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "POST /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8/action" status: 200 len: 32 microversion: 2.1 time: 0.112653 Sep 02 17:10:29.085474 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 172/338] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:28 2021] POST /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8/action => generated 32 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 17:10:29.094361 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-e2934075-08a8-4599-96d6-97f542491db2 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:29.095091 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-e2934075-08a8-4599-96d6-97f542491db2 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:29.101305 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e2934075-08a8-4599-96d6-97f542491db2 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:29.101769 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e2934075-08a8-4599-96d6-97f542491db2 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:29.102671 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e2934075-08a8-4599-96d6-97f542491db2 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:29.103121 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e2934075-08a8-4599-96d6-97f542491db2 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:29.224359 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-d337974e-45b0-42b1-88da-969d40125a51 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 28191 microversion: 2.1 time: 0.160393 Sep 02 17:10:29.225562 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 167/339] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:29 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 28191 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:10:29.232788 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-09d4f454-b634-45b9-a67b-f756ca4fcb00 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:29.233697 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-09d4f454-b634-45b9-a67b-f756ca4fcb00 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:29.240576 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-09d4f454-b634-45b9-a67b-f756ca4fcb00 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:29.241018 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-09d4f454-b634-45b9-a67b-f756ca4fcb00 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:29.242283 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-09d4f454-b634-45b9-a67b-f756ca4fcb00 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:29.242736 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-09d4f454-b634-45b9-a67b-f756ca4fcb00 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:29.254292 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-e2934075-08a8-4599-96d6-97f542491db2 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:29.264331 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-e2934075-08a8-4599-96d6-97f542491db2 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1522 microversion: 2.1 time: 0.173512 Sep 02 17:10:29.266370 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 173/340] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:29 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:10:29.358889 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-09d4f454-b634-45b9-a67b-f756ca4fcb00 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 28134 microversion: 2.20 time: 0.130701 Sep 02 17:10:29.364823 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 168/341] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:10:29 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 28134 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:10:29.822256 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-e1053691-098b-441a-a7c3-9d3113dc4094 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67ac6394-c40f-4273-8169-d53599d9a156"}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:29.823328 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-e1053691-098b-441a-a7c3-9d3113dc4094 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 824de352-7b8c-4ab6-8e42-1958f7b70c25] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:29.829257 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e1053691-098b-441a-a7c3-9d3113dc4094 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:29.829701 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e1053691-098b-441a-a7c3-9d3113dc4094 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:29.830737 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e1053691-098b-441a-a7c3-9d3113dc4094 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:29.831384 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e1053691-098b-441a-a7c3-9d3113dc4094 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:30.183496 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-e1053691-098b-441a-a7c3-9d3113dc4094 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "POST /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.364356 Sep 02 17:10:30.184557 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 174/342] 10.222.0.41 () {60 vars in 1323 bytes} [Thu Sep 2 17:10:29 2021] POST /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25/os-volume_attachments => generated 194 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:10:30.243107 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-2db1c518-7ed8-48d7-aebd-3ca30e85c5c5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:30.246136 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-2db1c518-7ed8-48d7-aebd-3ca30e85c5c5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:30.260835 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2db1c518-7ed8-48d7-aebd-3ca30e85c5c5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:30.261475 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2db1c518-7ed8-48d7-aebd-3ca30e85c5c5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:30.262329 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2db1c518-7ed8-48d7-aebd-3ca30e85c5c5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:30.262788 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2db1c518-7ed8-48d7-aebd-3ca30e85c5c5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:30.288050 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-02307d42-cee6-482d-b770-3a118cc5d954 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:30.289844 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-02307d42-cee6-482d-b770-3a118cc5d954 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:30.306214 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-02307d42-cee6-482d-b770-3a118cc5d954 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:30.307143 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-02307d42-cee6-482d-b770-3a118cc5d954 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:30.308760 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-02307d42-cee6-482d-b770-3a118cc5d954 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:30.309810 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-02307d42-cee6-482d-b770-3a118cc5d954 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:30.408596 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-2db1c518-7ed8-48d7-aebd-3ca30e85c5c5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 28191 microversion: 2.1 time: 0.172805 Sep 02 17:10:30.411266 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 169/343] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:30 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 28191 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:10:30.418112 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-b52986d6-1800-4987-a947-38455847746e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:30.419458 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-b52986d6-1800-4987-a947-38455847746e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:30.427010 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b52986d6-1800-4987-a947-38455847746e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:30.427751 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b52986d6-1800-4987-a947-38455847746e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:30.429043 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b52986d6-1800-4987-a947-38455847746e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:30.429703 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b52986d6-1800-4987-a947-38455847746e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:30.504313 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-02307d42-cee6-482d-b770-3a118cc5d954 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:30.514207 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-02307d42-cee6-482d-b770-3a118cc5d954 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1522 microversion: 2.1 time: 0.235210 Sep 02 17:10:30.518669 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 175/344] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:30 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:10:30.580329 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-b52986d6-1800-4987-a947-38455847746e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 28134 microversion: 2.20 time: 0.166924 Sep 02 17:10:30.581954 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 170/345] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:10:30 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 28134 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:10:31.422328 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-732e3ccd-5418-4209-bccb-0f584ca1bbf5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:31.423475 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-732e3ccd-5418-4209-bccb-0f584ca1bbf5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:31.430793 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-732e3ccd-5418-4209-bccb-0f584ca1bbf5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:31.431233 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-732e3ccd-5418-4209-bccb-0f584ca1bbf5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:31.432226 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-732e3ccd-5418-4209-bccb-0f584ca1bbf5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:31.432725 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-732e3ccd-5418-4209-bccb-0f584ca1bbf5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:31.533179 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-d662e37f-7de5-4ebd-88df-cdfe8e206d58 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:31.534390 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-d662e37f-7de5-4ebd-88df-cdfe8e206d58 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:31.542719 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d662e37f-7de5-4ebd-88df-cdfe8e206d58 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:31.543489 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d662e37f-7de5-4ebd-88df-cdfe8e206d58 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:31.544445 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d662e37f-7de5-4ebd-88df-cdfe8e206d58 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:31.544962 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d662e37f-7de5-4ebd-88df-cdfe8e206d58 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:31.594512 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-732e3ccd-5418-4209-bccb-0f584ca1bbf5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 28477 microversion: 2.1 time: 0.175936 Sep 02 17:10:31.595184 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 176/346] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:31 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 28477 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:10:31.600643 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-b13b79cb-ce86-48e0-b003-5428ef76f16d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:31.602419 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-b13b79cb-ce86-48e0-b003-5428ef76f16d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:31.609459 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b13b79cb-ce86-48e0-b003-5428ef76f16d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:31.609969 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b13b79cb-ce86-48e0-b003-5428ef76f16d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:31.611236 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b13b79cb-ce86-48e0-b003-5428ef76f16d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:31.611633 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b13b79cb-ce86-48e0-b003-5428ef76f16d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:31.689709 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-d662e37f-7de5-4ebd-88df-cdfe8e206d58 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:31.698369 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-d662e37f-7de5-4ebd-88df-cdfe8e206d58 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1522 microversion: 2.1 time: 0.169957 Sep 02 17:10:31.699130 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 171/347] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:31 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:10:31.776415 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-b13b79cb-ce86-48e0-b003-5428ef76f16d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 28421 microversion: 2.20 time: 0.179151 Sep 02 17:10:31.777321 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 177/348] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:10:31 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 28421 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:10:32.606742 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-ac94ba76-1af3-433f-8b35-4b7a9a77b05b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:32.607547 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-ac94ba76-1af3-433f-8b35-4b7a9a77b05b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:32.614116 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ac94ba76-1af3-433f-8b35-4b7a9a77b05b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:32.614556 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ac94ba76-1af3-433f-8b35-4b7a9a77b05b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:32.615336 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ac94ba76-1af3-433f-8b35-4b7a9a77b05b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:32.615767 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ac94ba76-1af3-433f-8b35-4b7a9a77b05b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:32.716544 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-186fef9e-0432-490a-97c0-162e210a9cdf tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:32.717258 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-186fef9e-0432-490a-97c0-162e210a9cdf tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:32.723578 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-186fef9e-0432-490a-97c0-162e210a9cdf tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:32.724018 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-186fef9e-0432-490a-97c0-162e210a9cdf tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:32.724771 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-186fef9e-0432-490a-97c0-162e210a9cdf tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:32.725193 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-186fef9e-0432-490a-97c0-162e210a9cdf tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:32.731236 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-ac94ba76-1af3-433f-8b35-4b7a9a77b05b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 28477 microversion: 2.1 time: 0.128154 Sep 02 17:10:32.731865 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 172/349] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:32 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 28477 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:10:32.789170 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-da280e26-2da0-43c5-86d4-b4516405b22c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:32.790179 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-da280e26-2da0-43c5-86d4-b4516405b22c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:32.797661 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-da280e26-2da0-43c5-86d4-b4516405b22c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:32.798111 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-da280e26-2da0-43c5-86d4-b4516405b22c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:32.798919 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-da280e26-2da0-43c5-86d4-b4516405b22c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:32.799359 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-da280e26-2da0-43c5-86d4-b4516405b22c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:32.852866 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-186fef9e-0432-490a-97c0-162e210a9cdf tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:32.860287 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-186fef9e-0432-490a-97c0-162e210a9cdf tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1522 microversion: 2.1 time: 0.148134 Sep 02 17:10:32.861043 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 178/350] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:32 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:10:32.930166 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-da280e26-2da0-43c5-86d4-b4516405b22c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 28421 microversion: 2.20 time: 0.144992 Sep 02 17:10:32.930867 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 173/351] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:10:32 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 28421 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:10:33.271779 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-d30ad774-ce49-47c7-ba4f-ba15a6c608a9 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1513318604", "imageRef": "22ce6e29-f3a7-49f0-b93a-ddbffa14e44e", "flavorRef": "452"}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:33.325935 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.network.neutron [None req-d30ad774-ce49-47c7-ba4f-ba15a6c608a9 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] validate_networks() for None {{(pid=108417) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 17:10:33.608202 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-d30ad774-ce49-47c7-ba4f-ba15a6c608a9 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Flavor limits 0:0:0 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 17:10:33.608618 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-d30ad774-ce49-47c7-ba4f-ba15a6c608a9 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Image limits 0:0:0 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 17:10:33.609089 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-d30ad774-ce49-47c7-ba4f-ba15a6c608a9 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Flavor pref 0:0:0 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 17:10:33.609490 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-d30ad774-ce49-47c7-ba4f-ba15a6c608a9 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Image pref 0:0:0 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 17:10:33.609895 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-d30ad774-ce49-47c7-ba4f-ba15a6c608a9 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 17:10:33.619670 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d30ad774-ce49-47c7-ba4f-ba15a6c608a9 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:33.620046 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d30ad774-ce49-47c7-ba4f-ba15a6c608a9 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:33.620834 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d30ad774-ce49-47c7-ba4f-ba15a6c608a9 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:33.621257 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d30ad774-ce49-47c7-ba4f-ba15a6c608a9 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:33.636877 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.quota [None req-d30ad774-ce49-47c7-ba4f-ba15a6c608a9 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Getting quotas for project d359d9fe04534460a1a5f839298fc0f2. Resources: {'instances', 'cores', 'ram'} {{(pid=108417) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 17:10:33.640649 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.quota [None req-d30ad774-ce49-47c7-ba4f-ba15a6c608a9 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Getting quotas for user 0ccfbcc47ac249eab55ef847b69af3d7 and project d359d9fe04534460a1a5f839298fc0f2. Resources: {'instances', 'cores', 'ram'} {{(pid=108417) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 17:10:33.651615 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-d30ad774-ce49-47c7-ba4f-ba15a6c608a9 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Going to run 1 instances... {{(pid=108417) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 17:10:33.653907 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-d30ad774-ce49-47c7-ba4f-ba15a6c608a9 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] [instance: 5bb3c756-c618-430e-8157-87b5f85b7df5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22ce6e29-f3a7-49f0-b93a-ddbffa14e44e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108417) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 17:10:33.697240 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-d30ad774-ce49-47c7-ba4f-ba15a6c608a9 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.429060 Sep 02 17:10:33.697869 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 179/352] 10.222.0.41 () {60 vars in 1147 bytes} [Thu Sep 2 17:10:33 2021] POST /compute/v2.1/servers => generated 380 bytes in 430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 17:10:33.708404 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-91c68a31-8316-456d-8184-939c520df974 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:33.709294 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-91c68a31-8316-456d-8184-939c520df974 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] [instance: 5bb3c756-c618-430e-8157-87b5f85b7df5] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:33.744206 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-ef3a63a4-9bfe-497a-90cd-af11e71c99c8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:33.745629 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-ef3a63a4-9bfe-497a-90cd-af11e71c99c8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:33.756225 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ef3a63a4-9bfe-497a-90cd-af11e71c99c8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:33.757020 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ef3a63a4-9bfe-497a-90cd-af11e71c99c8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:33.758413 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ef3a63a4-9bfe-497a-90cd-af11e71c99c8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:33.759223 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ef3a63a4-9bfe-497a-90cd-af11e71c99c8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:33.769743 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-91c68a31-8316-456d-8184-939c520df974 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccfbcc47ac249eab55ef847b69af3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd359d9fe04534460a1a5f839298fc0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:33.777932 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-91c68a31-8316-456d-8184-939c520df974 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] 10.222.0.41 "GET /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5" status: 200 len: 1215 microversion: 2.1 time: 0.073240 Sep 02 17:10:33.778926 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 174/353] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:33 2021] GET /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5 => generated 1215 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:33.877810 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-ea0ee1ad-21e3-4f70-91f0-4ace503bf262 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:33.878373 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-ea0ee1ad-21e3-4f70-91f0-4ace503bf262 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:33.886387 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ea0ee1ad-21e3-4f70-91f0-4ace503bf262 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:33.886869 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ea0ee1ad-21e3-4f70-91f0-4ace503bf262 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:33.887650 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ea0ee1ad-21e3-4f70-91f0-4ace503bf262 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:33.888196 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ea0ee1ad-21e3-4f70-91f0-4ace503bf262 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:33.926947 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-ef3a63a4-9bfe-497a-90cd-af11e71c99c8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 28582 microversion: 2.1 time: 0.187076 Sep 02 17:10:33.927820 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 180/354] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:33 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 28582 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:10:33.942244 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-74ae8a91-d61b-4c90-addf-898995576b42 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:33.943306 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-74ae8a91-d61b-4c90-addf-898995576b42 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:33.951004 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-74ae8a91-d61b-4c90-addf-898995576b42 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:33.951388 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-74ae8a91-d61b-4c90-addf-898995576b42 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:33.952318 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-74ae8a91-d61b-4c90-addf-898995576b42 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:33.952758 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-74ae8a91-d61b-4c90-addf-898995576b42 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:34.039044 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-ea0ee1ad-21e3-4f70-91f0-4ace503bf262 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:34.047628 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-ea0ee1ad-21e3-4f70-91f0-4ace503bf262 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1522 microversion: 2.1 time: 0.173839 Sep 02 17:10:34.048201 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 175/355] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:33 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:10:34.112666 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-74ae8a91-d61b-4c90-addf-898995576b42 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 28584 microversion: 2.20 time: 0.174452 Sep 02 17:10:34.113345 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 181/356] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:10:33 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 28584 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:10:34.799019 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-5fa01cf7-e5e9-4e66-a637-1e8a5bfa55fd tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:34.800082 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-5fa01cf7-e5e9-4e66-a637-1e8a5bfa55fd tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] [instance: 5bb3c756-c618-430e-8157-87b5f85b7df5] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:34.808360 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5fa01cf7-e5e9-4e66-a637-1e8a5bfa55fd tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:34.808807 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5fa01cf7-e5e9-4e66-a637-1e8a5bfa55fd tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:34.809583 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5fa01cf7-e5e9-4e66-a637-1e8a5bfa55fd tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:34.810027 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5fa01cf7-e5e9-4e66-a637-1e8a5bfa55fd tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:34.883573 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-5fa01cf7-e5e9-4e66-a637-1e8a5bfa55fd tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccfbcc47ac249eab55ef847b69af3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd359d9fe04534460a1a5f839298fc0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:34.892870 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-5fa01cf7-e5e9-4e66-a637-1e8a5bfa55fd tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] 10.222.0.41 "GET /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5" status: 200 len: 1267 microversion: 2.1 time: 0.100211 Sep 02 17:10:34.893768 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 176/357] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:34 2021] GET /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5 => generated 1267 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:10:34.941448 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-a33e26c6-c87d-4ac2-bf3f-91be9de5c4be tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:34.942518 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-a33e26c6-c87d-4ac2-bf3f-91be9de5c4be tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:34.949979 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a33e26c6-c87d-4ac2-bf3f-91be9de5c4be tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:34.951031 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a33e26c6-c87d-4ac2-bf3f-91be9de5c4be tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:34.951968 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a33e26c6-c87d-4ac2-bf3f-91be9de5c4be tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:34.952547 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a33e26c6-c87d-4ac2-bf3f-91be9de5c4be tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:35.066106 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-ff980b39-28d0-44c1-bd8e-e0d554b9ece6 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:35.066772 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-ff980b39-28d0-44c1-bd8e-e0d554b9ece6 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:35.073677 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ff980b39-28d0-44c1-bd8e-e0d554b9ece6 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:35.074231 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ff980b39-28d0-44c1-bd8e-e0d554b9ece6 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:35.075025 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ff980b39-28d0-44c1-bd8e-e0d554b9ece6 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:35.075471 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ff980b39-28d0-44c1-bd8e-e0d554b9ece6 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:35.178368 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-a33e26c6-c87d-4ac2-bf3f-91be9de5c4be tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 28644 microversion: 2.1 time: 0.242541 Sep 02 17:10:35.179988 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 182/358] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:34 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 28644 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:10:35.186967 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-18959f99-bf68-46a3-aad8-eef78262239f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:35.195852 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-18959f99-bf68-46a3-aad8-eef78262239f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:35.205623 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-18959f99-bf68-46a3-aad8-eef78262239f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:35.210695 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-18959f99-bf68-46a3-aad8-eef78262239f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:35.212047 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-18959f99-bf68-46a3-aad8-eef78262239f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:35.213006 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-18959f99-bf68-46a3-aad8-eef78262239f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:35.228663 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-ff980b39-28d0-44c1-bd8e-e0d554b9ece6 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:35.244230 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-ff980b39-28d0-44c1-bd8e-e0d554b9ece6 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1522 microversion: 2.1 time: 0.182021 Sep 02 17:10:35.245260 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 177/359] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:35 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:35.364699 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-18959f99-bf68-46a3-aad8-eef78262239f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 28586 microversion: 2.20 time: 0.182819 Sep 02 17:10:35.365335 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 183/360] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:10:35 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 28586 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:10:35.914761 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-5c54af7d-f53d-475a-849a-b1e217f82349 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:35.915725 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-5c54af7d-f53d-475a-849a-b1e217f82349 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] [instance: 5bb3c756-c618-430e-8157-87b5f85b7df5] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:35.922655 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5c54af7d-f53d-475a-849a-b1e217f82349 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:35.923527 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5c54af7d-f53d-475a-849a-b1e217f82349 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:35.925071 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5c54af7d-f53d-475a-849a-b1e217f82349 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:35.926084 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5c54af7d-f53d-475a-849a-b1e217f82349 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:36.018883 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-5c54af7d-f53d-475a-849a-b1e217f82349 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccfbcc47ac249eab55ef847b69af3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd359d9fe04534460a1a5f839298fc0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:36.027267 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-5c54af7d-f53d-475a-849a-b1e217f82349 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] 10.222.0.41 "GET /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5" status: 200 len: 1273 microversion: 2.1 time: 0.117045 Sep 02 17:10:36.028088 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 178/361] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:35 2021] GET /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5 => generated 1273 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:36.192928 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-8740623c-aca8-4b2a-97d8-7e83ad28dd1e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:36.194087 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-8740623c-aca8-4b2a-97d8-7e83ad28dd1e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:36.200808 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8740623c-aca8-4b2a-97d8-7e83ad28dd1e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:36.201256 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8740623c-aca8-4b2a-97d8-7e83ad28dd1e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:36.202028 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8740623c-aca8-4b2a-97d8-7e83ad28dd1e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:36.202463 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8740623c-aca8-4b2a-97d8-7e83ad28dd1e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:36.261239 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-ef7a64a8-c101-459e-85e5-dcf9b2c60812 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:36.261847 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-ef7a64a8-c101-459e-85e5-dcf9b2c60812 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:36.267886 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ef7a64a8-c101-459e-85e5-dcf9b2c60812 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:36.268260 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ef7a64a8-c101-459e-85e5-dcf9b2c60812 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:36.269022 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ef7a64a8-c101-459e-85e5-dcf9b2c60812 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:36.269566 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ef7a64a8-c101-459e-85e5-dcf9b2c60812 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:36.359534 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-8740623c-aca8-4b2a-97d8-7e83ad28dd1e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 28644 microversion: 2.1 time: 0.170545 Sep 02 17:10:36.360288 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 184/362] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:36 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 28644 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:10:36.378540 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-4dbf776d-1dc4-4599-8c58-e83e0fc8ffc8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:36.379629 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-4dbf776d-1dc4-4599-8c58-e83e0fc8ffc8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:36.386364 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4dbf776d-1dc4-4599-8c58-e83e0fc8ffc8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:36.387174 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4dbf776d-1dc4-4599-8c58-e83e0fc8ffc8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:36.388157 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4dbf776d-1dc4-4599-8c58-e83e0fc8ffc8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:36.388792 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4dbf776d-1dc4-4599-8c58-e83e0fc8ffc8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:36.440894 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-ef7a64a8-c101-459e-85e5-dcf9b2c60812 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:36.450547 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-ef7a64a8-c101-459e-85e5-dcf9b2c60812 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1522 microversion: 2.1 time: 0.193034 Sep 02 17:10:36.451485 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 179/363] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:36 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:36.516007 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-4dbf776d-1dc4-4599-8c58-e83e0fc8ffc8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 28586 microversion: 2.20 time: 0.141971 Sep 02 17:10:36.518066 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 185/364] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:10:36 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 28586 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:10:37.046289 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-48acda75-89b7-4104-b4dc-7ee231b27001 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:37.047359 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-48acda75-89b7-4104-b4dc-7ee231b27001 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] [instance: 5bb3c756-c618-430e-8157-87b5f85b7df5] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:37.057573 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-48acda75-89b7-4104-b4dc-7ee231b27001 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:37.058032 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-48acda75-89b7-4104-b4dc-7ee231b27001 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:37.058848 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-48acda75-89b7-4104-b4dc-7ee231b27001 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:37.059598 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-48acda75-89b7-4104-b4dc-7ee231b27001 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:37.236445 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-48acda75-89b7-4104-b4dc-7ee231b27001 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccfbcc47ac249eab55ef847b69af3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd359d9fe04534460a1a5f839298fc0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:37.246146 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-48acda75-89b7-4104-b4dc-7ee231b27001 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] 10.222.0.41 "GET /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5" status: 200 len: 1315 microversion: 2.1 time: 0.203571 Sep 02 17:10:37.247725 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 180/365] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:37 2021] GET /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:37.374549 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-8e3edb9f-06de-47a0-b7d0-85d1a822c6f0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:37.376494 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-8e3edb9f-06de-47a0-b7d0-85d1a822c6f0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:37.386320 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8e3edb9f-06de-47a0-b7d0-85d1a822c6f0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:37.387127 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8e3edb9f-06de-47a0-b7d0-85d1a822c6f0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:37.389034 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8e3edb9f-06de-47a0-b7d0-85d1a822c6f0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:37.389827 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8e3edb9f-06de-47a0-b7d0-85d1a822c6f0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:37.469190 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-8f4ae72c-4fd0-4570-aa6f-acac17d2d5c9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:37.469904 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-8f4ae72c-4fd0-4570-aa6f-acac17d2d5c9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:37.476921 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8f4ae72c-4fd0-4570-aa6f-acac17d2d5c9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:37.477681 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8f4ae72c-4fd0-4570-aa6f-acac17d2d5c9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:37.478783 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8f4ae72c-4fd0-4570-aa6f-acac17d2d5c9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:37.479424 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8f4ae72c-4fd0-4570-aa6f-acac17d2d5c9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:37.560935 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-8e3edb9f-06de-47a0-b7d0-85d1a822c6f0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 28644 microversion: 2.1 time: 0.191559 Sep 02 17:10:37.562542 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 186/366] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:37 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 28644 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:10:37.582218 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-2e6dc166-5454-440a-9113-4979dc816e16 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:37.583753 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-2e6dc166-5454-440a-9113-4979dc816e16 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:37.599816 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2e6dc166-5454-440a-9113-4979dc816e16 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:37.601765 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2e6dc166-5454-440a-9113-4979dc816e16 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:37.604140 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2e6dc166-5454-440a-9113-4979dc816e16 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:37.607074 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2e6dc166-5454-440a-9113-4979dc816e16 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:37.751669 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-8f4ae72c-4fd0-4570-aa6f-acac17d2d5c9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:37.773620 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-8f4ae72c-4fd0-4570-aa6f-acac17d2d5c9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1522 microversion: 2.1 time: 0.309569 Sep 02 17:10:37.783652 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 181/367] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:37 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:10:37.786799 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-2e6dc166-5454-440a-9113-4979dc816e16 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 28586 microversion: 2.20 time: 0.221937 Sep 02 17:10:37.787492 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 187/368] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:10:37 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 28586 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:10:37.796477 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-1f761a25-876a-49ec-befa-4f1fd2c45c4b req-7bffa7e8-0e64-488e-ad3d-e1c3267b1367 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bb3c756-c618-430e-8157-87b5f85b7df5", "tag": "82a098ff-909c-44a4-b1c8-8ba281c63868"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:37.798588 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:10:37.798588 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:10:37.811267 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-1f761a25-876a-49ec-befa-4f1fd2c45c4b req-7bffa7e8-0e64-488e-ad3d-e1c3267b1367 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:37.812669 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-1f761a25-876a-49ec-befa-4f1fd2c45c4b req-7bffa7e8-0e64-488e-ad3d-e1c3267b1367 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:37.831733 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-1f761a25-876a-49ec-befa-4f1fd2c45c4b req-7bffa7e8-0e64-488e-ad3d-e1c3267b1367 service nova] Creating event network-changed:82a098ff-909c-44a4-b1c8-8ba281c63868 for instance 5bb3c756-c618-430e-8157-87b5f85b7df5 on hv-cinder-80626 Sep 02 17:10:37.839146 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-1f761a25-876a-49ec-befa-4f1fd2c45c4b req-7bffa7e8-0e64-488e-ad3d-e1c3267b1367 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052093 Sep 02 17:10:37.839962 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 182/369] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:10:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:10:38.264303 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-a20649c4-179a-4275-af54-8b95a1f0668f tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:38.265384 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-a20649c4-179a-4275-af54-8b95a1f0668f tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] [instance: 5bb3c756-c618-430e-8157-87b5f85b7df5] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:38.272045 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a20649c4-179a-4275-af54-8b95a1f0668f tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:38.272523 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a20649c4-179a-4275-af54-8b95a1f0668f tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:38.273306 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a20649c4-179a-4275-af54-8b95a1f0668f tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:38.273740 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a20649c4-179a-4275-af54-8b95a1f0668f tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:38.509099 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-a20649c4-179a-4275-af54-8b95a1f0668f tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccfbcc47ac249eab55ef847b69af3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd359d9fe04534460a1a5f839298fc0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:38.517471 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-a20649c4-179a-4275-af54-8b95a1f0668f tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] 10.222.0.41 "GET /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5" status: 200 len: 1315 microversion: 2.1 time: 0.256972 Sep 02 17:10:38.518818 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 188/370] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:38 2021] GET /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:38.572744 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-99791fa5-5d69-45d9-a6dd-9c3ea1ebd150 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:38.573804 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-99791fa5-5d69-45d9-a6dd-9c3ea1ebd150 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:38.580308 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-99791fa5-5d69-45d9-a6dd-9c3ea1ebd150 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:38.580585 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-99791fa5-5d69-45d9-a6dd-9c3ea1ebd150 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:38.590158 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-99791fa5-5d69-45d9-a6dd-9c3ea1ebd150 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:38.590616 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-99791fa5-5d69-45d9-a6dd-9c3ea1ebd150 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:38.783670 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-99791fa5-5d69-45d9-a6dd-9c3ea1ebd150 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 28644 microversion: 2.1 time: 0.215096 Sep 02 17:10:38.784331 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 183/371] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:38 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 28644 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:10:38.808416 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-d8e09dab-1da0-41a8-bbac-4ca3da2fd1d0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:38.812273 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-d8e09dab-1da0-41a8-bbac-4ca3da2fd1d0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:38.814196 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-54e2362e-8e4a-4abf-8ce0-75e623d0b86b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:38.814929 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-54e2362e-8e4a-4abf-8ce0-75e623d0b86b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:38.821448 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d8e09dab-1da0-41a8-bbac-4ca3da2fd1d0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:38.821954 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d8e09dab-1da0-41a8-bbac-4ca3da2fd1d0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:38.822793 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d8e09dab-1da0-41a8-bbac-4ca3da2fd1d0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:38.823291 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-54e2362e-8e4a-4abf-8ce0-75e623d0b86b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:38.823591 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d8e09dab-1da0-41a8-bbac-4ca3da2fd1d0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:38.824372 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-54e2362e-8e4a-4abf-8ce0-75e623d0b86b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:38.826081 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-54e2362e-8e4a-4abf-8ce0-75e623d0b86b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:38.826818 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-54e2362e-8e4a-4abf-8ce0-75e623d0b86b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:38.936119 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-d8e09dab-1da0-41a8-bbac-4ca3da2fd1d0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 28586 microversion: 2.20 time: 0.136354 Sep 02 17:10:38.936119 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 189/372] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:10:38 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 28586 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:10:38.941611 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-f7b3fbbf-ad4e-48cf-ad01-c409b52c38aa tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67ac6394-c40f-4273-8169-d53599d9a156"}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:38.943715 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-f7b3fbbf-ad4e-48cf-ad01-c409b52c38aa tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 824de352-7b8c-4ab6-8e42-1958f7b70c25] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:38.955435 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f7b3fbbf-ad4e-48cf-ad01-c409b52c38aa tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:38.955953 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f7b3fbbf-ad4e-48cf-ad01-c409b52c38aa tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:38.956976 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f7b3fbbf-ad4e-48cf-ad01-c409b52c38aa tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:38.957481 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f7b3fbbf-ad4e-48cf-ad01-c409b52c38aa tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:38.982604 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-54e2362e-8e4a-4abf-8ce0-75e623d0b86b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:38.997726 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-54e2362e-8e4a-4abf-8ce0-75e623d0b86b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1522 microversion: 2.1 time: 0.187717 Sep 02 17:10:38.998572 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 184/373] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:38 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:39.066914 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.wsgi [None req-f7b3fbbf-ad4e-48cf-ad01-c409b52c38aa tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] HTTP exception thrown: Invalid volume: volume 67ac6394-c40f-4273-8169-d53599d9a156 is already attached to instances: 824de352-7b8c-4ab6-8e42-1958f7b70c25 Sep 02 17:10:39.067522 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-f7b3fbbf-ad4e-48cf-ad01-c409b52c38aa tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Returning 400 to user: Invalid volume: volume 67ac6394-c40f-4273-8169-d53599d9a156 is already attached to instances: 824de352-7b8c-4ab6-8e42-1958f7b70c25 {{(pid=108417) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:10:39.068361 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-f7b3fbbf-ad4e-48cf-ad01-c409b52c38aa tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "POST /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.134066 Sep 02 17:10:39.068928 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 190/374] 10.222.0.41 () {60 vars in 1323 bytes} [Thu Sep 2 17:10:38 2021] POST /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25/os-volume_attachments => generated 174 bytes in 135 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 17:10:39.137812 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-47e28a25-45c9-476c-bd60-c0217fc9391d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:39.138305 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-47e28a25-45c9-476c-bd60-c0217fc9391d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 824de352-7b8c-4ab6-8e42-1958f7b70c25] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:39.144411 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-47e28a25-45c9-476c-bd60-c0217fc9391d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:39.144908 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-47e28a25-45c9-476c-bd60-c0217fc9391d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:39.146365 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-47e28a25-45c9-476c-bd60-c0217fc9391d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:39.147024 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-47e28a25-45c9-476c-bd60-c0217fc9391d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:39.305875 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.objects.instance [None req-47e28a25-45c9-476c-bd60-c0217fc9391d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lazy-loading 'services' on Instance uuid 824de352-7b8c-4ab6-8e42-1958f7b70c25 {{(pid=108418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 17:10:39.428110 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-47e28a25-45c9-476c-bd60-c0217fc9391d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "DELETE /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25/os-volume_attachments/67ac6394-c40f-4273-8169-d53599d9a156" status: 202 len: 0 microversion: 2.1 time: 0.293604 Sep 02 17:10:39.428933 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 185/375] 10.222.0.41 () {58 vars in 1416 bytes} [Thu Sep 2 17:10:39 2021] DELETE /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25/os-volume_attachments/67ac6394-c40f-4273-8169-d53599d9a156 => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:10:39.438323 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-62b404d0-4085-442c-a1e3-a910c33be25f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:39.439575 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-62b404d0-4085-442c-a1e3-a910c33be25f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 824de352-7b8c-4ab6-8e42-1958f7b70c25] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:39.446576 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-62b404d0-4085-442c-a1e3-a910c33be25f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:39.447411 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-62b404d0-4085-442c-a1e3-a910c33be25f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:39.448217 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-62b404d0-4085-442c-a1e3-a910c33be25f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:39.448922 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-62b404d0-4085-442c-a1e3-a910c33be25f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:39.484164 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-62b404d0-4085-442c-a1e3-a910c33be25f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050652 Sep 02 17:10:39.484711 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 191/376] 10.222.0.41 () {58 vars in 1302 bytes} [Thu Sep 2 17:10:39 2021] GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:10:39.535675 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-3163a3b3-423b-43ad-a7d4-83f11dfb2a98 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:39.536441 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-3163a3b3-423b-43ad-a7d4-83f11dfb2a98 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] [instance: 5bb3c756-c618-430e-8157-87b5f85b7df5] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:39.542708 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3163a3b3-423b-43ad-a7d4-83f11dfb2a98 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:39.543172 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3163a3b3-423b-43ad-a7d4-83f11dfb2a98 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:39.543949 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3163a3b3-423b-43ad-a7d4-83f11dfb2a98 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:39.544630 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3163a3b3-423b-43ad-a7d4-83f11dfb2a98 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:39.681071 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-3163a3b3-423b-43ad-a7d4-83f11dfb2a98 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccfbcc47ac249eab55ef847b69af3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd359d9fe04534460a1a5f839298fc0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:39.690178 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-3163a3b3-423b-43ad-a7d4-83f11dfb2a98 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] 10.222.0.41 "GET /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5" status: 200 len: 1315 microversion: 2.1 time: 0.158297 Sep 02 17:10:39.691069 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 186/377] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:39 2021] GET /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:39.794983 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-f2255385-7b18-4dd7-bdb6-c90789dff08c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:39.795887 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-f2255385-7b18-4dd7-bdb6-c90789dff08c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:39.801693 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f2255385-7b18-4dd7-bdb6-c90789dff08c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:39.802138 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f2255385-7b18-4dd7-bdb6-c90789dff08c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:39.802922 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f2255385-7b18-4dd7-bdb6-c90789dff08c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:39.803351 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f2255385-7b18-4dd7-bdb6-c90789dff08c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:39.944862 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-95b29ca1-8a38-4477-955e-61e13f25d201 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:39.945828 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-95b29ca1-8a38-4477-955e-61e13f25d201 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:39.951972 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-95b29ca1-8a38-4477-955e-61e13f25d201 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:39.952415 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-95b29ca1-8a38-4477-955e-61e13f25d201 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:39.953177 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-95b29ca1-8a38-4477-955e-61e13f25d201 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:39.953612 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-95b29ca1-8a38-4477-955e-61e13f25d201 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:39.963250 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-f2255385-7b18-4dd7-bdb6-c90789dff08c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 28644 microversion: 2.1 time: 0.171756 Sep 02 17:10:39.964184 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 192/378] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:39 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 28644 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:10:40.017761 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-2f216d8a-fd86-42dd-b9ba-8a925d96ab48 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:40.018752 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-2f216d8a-fd86-42dd-b9ba-8a925d96ab48 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:40.025291 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2f216d8a-fd86-42dd-b9ba-8a925d96ab48 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:40.025731 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2f216d8a-fd86-42dd-b9ba-8a925d96ab48 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:40.026514 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2f216d8a-fd86-42dd-b9ba-8a925d96ab48 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:40.026970 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2f216d8a-fd86-42dd-b9ba-8a925d96ab48 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:40.049680 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-95b29ca1-8a38-4477-955e-61e13f25d201 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 28586 microversion: 2.20 time: 0.109246 Sep 02 17:10:40.050322 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 187/379] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:10:39 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 28586 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:10:40.148653 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-2f216d8a-fd86-42dd-b9ba-8a925d96ab48 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:40.156776 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-2f216d8a-fd86-42dd-b9ba-8a925d96ab48 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1522 microversion: 2.1 time: 0.144970 Sep 02 17:10:40.157619 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 193/380] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:40 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:10:40.496491 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-f0984ee9-53fb-4b66-901f-d1ee374e90a5 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:40.497384 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-f0984ee9-53fb-4b66-901f-d1ee374e90a5 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 824de352-7b8c-4ab6-8e42-1958f7b70c25] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:40.503854 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f0984ee9-53fb-4b66-901f-d1ee374e90a5 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:40.504295 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f0984ee9-53fb-4b66-901f-d1ee374e90a5 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:40.505049 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f0984ee9-53fb-4b66-901f-d1ee374e90a5 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:40.505478 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f0984ee9-53fb-4b66-901f-d1ee374e90a5 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:40.533922 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-f0984ee9-53fb-4b66-901f-d1ee374e90a5 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041556 Sep 02 17:10:40.534473 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 188/381] 10.222.0.41 () {58 vars in 1302 bytes} [Thu Sep 2 17:10:40 2021] GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:10:40.712737 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-78f44178-fe8c-414a-b392-887251b4bab5 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:40.713354 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-78f44178-fe8c-414a-b392-887251b4bab5 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] [instance: 5bb3c756-c618-430e-8157-87b5f85b7df5] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:40.723086 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-78f44178-fe8c-414a-b392-887251b4bab5 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:40.723535 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-78f44178-fe8c-414a-b392-887251b4bab5 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:40.724318 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-78f44178-fe8c-414a-b392-887251b4bab5 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:40.724753 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-78f44178-fe8c-414a-b392-887251b4bab5 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:40.866486 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-78f44178-fe8c-414a-b392-887251b4bab5 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccfbcc47ac249eab55ef847b69af3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd359d9fe04534460a1a5f839298fc0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:40.874405 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-78f44178-fe8c-414a-b392-887251b4bab5 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] 10.222.0.41 "GET /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5" status: 200 len: 1315 microversion: 2.1 time: 0.170333 Sep 02 17:10:40.875004 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 194/382] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:40 2021] GET /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:40.974926 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-249e44fe-897c-4778-8850-35436d3ad80a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:40.975852 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-249e44fe-897c-4778-8850-35436d3ad80a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:40.981526 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-249e44fe-897c-4778-8850-35436d3ad80a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:40.981962 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-249e44fe-897c-4778-8850-35436d3ad80a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:40.982734 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-249e44fe-897c-4778-8850-35436d3ad80a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:40.983161 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-249e44fe-897c-4778-8850-35436d3ad80a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:41.062355 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-4e3e6dd4-b1d3-40bb-b507-a74cddf7f47e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:41.063381 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-4e3e6dd4-b1d3-40bb-b507-a74cddf7f47e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:41.070228 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4e3e6dd4-b1d3-40bb-b507-a74cddf7f47e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:41.070696 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4e3e6dd4-b1d3-40bb-b507-a74cddf7f47e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:41.071462 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4e3e6dd4-b1d3-40bb-b507-a74cddf7f47e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:41.071897 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4e3e6dd4-b1d3-40bb-b507-a74cddf7f47e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:41.090012 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-249e44fe-897c-4778-8850-35436d3ad80a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 28644 microversion: 2.1 time: 0.118102 Sep 02 17:10:41.091259 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 189/383] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:40 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 28644 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:10:41.184069 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-4e3e6dd4-b1d3-40bb-b507-a74cddf7f47e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 28586 microversion: 2.20 time: 0.125191 Sep 02 17:10:41.184714 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 195/384] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:10:41 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 28586 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:10:41.212782 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-f3004113-eff0-44c3-a02a-8e154dcac92c tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:41.213476 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-f3004113-eff0-44c3-a02a-8e154dcac92c tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:41.220013 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f3004113-eff0-44c3-a02a-8e154dcac92c tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:41.220463 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f3004113-eff0-44c3-a02a-8e154dcac92c tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:41.221228 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f3004113-eff0-44c3-a02a-8e154dcac92c tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:41.221668 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f3004113-eff0-44c3-a02a-8e154dcac92c tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:41.350315 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-f3004113-eff0-44c3-a02a-8e154dcac92c tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:41.358893 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-f3004113-eff0-44c3-a02a-8e154dcac92c tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1522 microversion: 2.1 time: 0.150090 Sep 02 17:10:41.359453 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 190/385] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:41 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:41.546470 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-72e77c41-1cd4-44cf-830d-6804f34648e0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:41.547716 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-72e77c41-1cd4-44cf-830d-6804f34648e0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 824de352-7b8c-4ab6-8e42-1958f7b70c25] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:41.556415 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-72e77c41-1cd4-44cf-830d-6804f34648e0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:41.556784 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-72e77c41-1cd4-44cf-830d-6804f34648e0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:41.557551 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-72e77c41-1cd4-44cf-830d-6804f34648e0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:41.557977 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-72e77c41-1cd4-44cf-830d-6804f34648e0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:41.586320 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-72e77c41-1cd4-44cf-830d-6804f34648e0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044314 Sep 02 17:10:41.586895 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 196/386] 10.222.0.41 () {58 vars in 1302 bytes} [Thu Sep 2 17:10:41 2021] GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 17:10:41.742212 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-540f6ed6-be5d-4399-8fb0-a4892f6f9b52 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1810522540", "imageRef": "22ce6e29-f3a7-49f0-b93a-ddbffa14e44e", "flavorRef": "452", "networks": [{"uuid": "42e64c23-8d50-4a89-acaf-802979ed9882"}]}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:41.891803 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-f5a160f5-ad33-417d-ab2e-6917086984a3 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:41.892406 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-f5a160f5-ad33-417d-ab2e-6917086984a3 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] [instance: 5bb3c756-c618-430e-8157-87b5f85b7df5] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:41.898794 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f5a160f5-ad33-417d-ab2e-6917086984a3 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:41.899422 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f5a160f5-ad33-417d-ab2e-6917086984a3 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:41.900157 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f5a160f5-ad33-417d-ab2e-6917086984a3 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:41.900760 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f5a160f5-ad33-417d-ab2e-6917086984a3 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:42.028248 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-f5a160f5-ad33-417d-ab2e-6917086984a3 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccfbcc47ac249eab55ef847b69af3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd359d9fe04534460a1a5f839298fc0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:42.040414 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-f5a160f5-ad33-417d-ab2e-6917086984a3 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] 10.222.0.41 "GET /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5" status: 200 len: 1315 microversion: 2.1 time: 0.148942 Sep 02 17:10:42.040414 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 197/387] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:41 2021] GET /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:42.101670 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-9e1836fb-d029-4285-8785-f77c3f17ca2b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:42.102579 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-9e1836fb-d029-4285-8785-f77c3f17ca2b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:42.108300 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9e1836fb-d029-4285-8785-f77c3f17ca2b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:42.108747 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9e1836fb-d029-4285-8785-f77c3f17ca2b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:42.109509 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9e1836fb-d029-4285-8785-f77c3f17ca2b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:42.109964 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9e1836fb-d029-4285-8785-f77c3f17ca2b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:42.215953 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-9e1836fb-d029-4285-8785-f77c3f17ca2b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 28644 microversion: 2.1 time: 0.118137 Sep 02 17:10:42.217126 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 198/388] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:42 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 28644 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:10:42.223165 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-6ad6ccf7-6a38-439f-b610-bdbdacbb1e84 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:42.224406 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-6ad6ccf7-6a38-439f-b610-bdbdacbb1e84 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:42.231943 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6ad6ccf7-6a38-439f-b610-bdbdacbb1e84 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:42.232789 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6ad6ccf7-6a38-439f-b610-bdbdacbb1e84 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:42.233636 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6ad6ccf7-6a38-439f-b610-bdbdacbb1e84 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:42.234071 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6ad6ccf7-6a38-439f-b610-bdbdacbb1e84 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:42.349646 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-6ad6ccf7-6a38-439f-b610-bdbdacbb1e84 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 28586 microversion: 2.20 time: 0.130955 Sep 02 17:10:42.350193 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 199/389] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:10:42 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 28586 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:10:42.377262 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-526048ac-d457-4a54-94ae-461bf65e9b9f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:42.377955 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-526048ac-d457-4a54-94ae-461bf65e9b9f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:42.384449 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-526048ac-d457-4a54-94ae-461bf65e9b9f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:42.384896 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-526048ac-d457-4a54-94ae-461bf65e9b9f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:42.385759 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-526048ac-d457-4a54-94ae-461bf65e9b9f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:42.386234 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-526048ac-d457-4a54-94ae-461bf65e9b9f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:42.512327 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-526048ac-d457-4a54-94ae-461bf65e9b9f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:42.519661 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-526048ac-d457-4a54-94ae-461bf65e9b9f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1522 microversion: 2.1 time: 0.146289 Sep 02 17:10:42.520422 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 200/390] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:42 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:10:43.054236 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-5f3c3541-29d8-4b7e-9e8c-71b57de7821a tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:43.054876 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-5f3c3541-29d8-4b7e-9e8c-71b57de7821a tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] [instance: 5bb3c756-c618-430e-8157-87b5f85b7df5] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:43.061107 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5f3c3541-29d8-4b7e-9e8c-71b57de7821a tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:43.061650 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5f3c3541-29d8-4b7e-9e8c-71b57de7821a tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:43.062705 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5f3c3541-29d8-4b7e-9e8c-71b57de7821a tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:43.063149 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5f3c3541-29d8-4b7e-9e8c-71b57de7821a tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:43.192434 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-5f3c3541-29d8-4b7e-9e8c-71b57de7821a tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccfbcc47ac249eab55ef847b69af3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd359d9fe04534460a1a5f839298fc0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:43.200267 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-5f3c3541-29d8-4b7e-9e8c-71b57de7821a tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] 10.222.0.41 "GET /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5" status: 200 len: 1315 microversion: 2.1 time: 0.149683 Sep 02 17:10:43.200831 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 201/391] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:43 2021] GET /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:10:43.228005 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-add341c9-570e-49f2-8b96-c68179ec10e9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:43.228917 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-add341c9-570e-49f2-8b96-c68179ec10e9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:43.234703 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-add341c9-570e-49f2-8b96-c68179ec10e9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:43.235148 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-add341c9-570e-49f2-8b96-c68179ec10e9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:43.236186 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-add341c9-570e-49f2-8b96-c68179ec10e9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:43.236612 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-add341c9-570e-49f2-8b96-c68179ec10e9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:43.364082 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-add341c9-570e-49f2-8b96-c68179ec10e9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 28644 microversion: 2.1 time: 0.139493 Sep 02 17:10:43.364879 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 202/392] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:43 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 28644 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:10:43.374173 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-9321c03f-6c01-43bf-a195-207ebb97aa68 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:43.375329 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-9321c03f-6c01-43bf-a195-207ebb97aa68 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:43.381787 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9321c03f-6c01-43bf-a195-207ebb97aa68 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:43.382784 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9321c03f-6c01-43bf-a195-207ebb97aa68 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:43.383550 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9321c03f-6c01-43bf-a195-207ebb97aa68 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:43.383973 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9321c03f-6c01-43bf-a195-207ebb97aa68 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:43.503190 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-9321c03f-6c01-43bf-a195-207ebb97aa68 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 28705 microversion: 2.20 time: 0.132970 Sep 02 17:10:43.504100 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 203/393] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:10:43 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 28705 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:10:43.537052 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-ab3f226b-b6e7-47fa-999f-b9e148a108da tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:43.537740 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-ab3f226b-b6e7-47fa-999f-b9e148a108da tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:43.544630 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ab3f226b-b6e7-47fa-999f-b9e148a108da tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:43.545078 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ab3f226b-b6e7-47fa-999f-b9e148a108da tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:43.545862 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ab3f226b-b6e7-47fa-999f-b9e148a108da tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:43.546278 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ab3f226b-b6e7-47fa-999f-b9e148a108da tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:43.669770 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-ab3f226b-b6e7-47fa-999f-b9e148a108da tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:43.676921 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-ab3f226b-b6e7-47fa-999f-b9e148a108da tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1522 microversion: 2.1 time: 0.143854 Sep 02 17:10:43.677479 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 204/394] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:43 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:10:43.982754 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [req-0c6c41cd-6756-4b97-bb97-5e7b5b30ad2a req-5126ce85-7fa1-4d04-9908-e00bd66be95e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bb3c756-c618-430e-8157-87b5f85b7df5", "name": "network-vif-plugged", "status": "completed", "tag": "82a098ff-909c-44a4-b1c8-8ba281c63868"}]} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:43.985390 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:10:43.985390 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: warnings.warn(msg) Sep 02 17:10:43.992691 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-0c6c41cd-6756-4b97-bb97-5e7b5b30ad2a req-5126ce85-7fa1-4d04-9908-e00bd66be95e service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:43.993135 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-0c6c41cd-6756-4b97-bb97-5e7b5b30ad2a req-5126ce85-7fa1-4d04-9908-e00bd66be95e service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:44.004185 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.compute.server_external_events [req-0c6c41cd-6756-4b97-bb97-5e7b5b30ad2a req-5126ce85-7fa1-4d04-9908-e00bd66be95e service nova] Creating event network-vif-plugged:82a098ff-909c-44a4-b1c8-8ba281c63868 for instance 5bb3c756-c618-430e-8157-87b5f85b7df5 on hv-cinder-80626 Sep 02 17:10:44.012191 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [req-0c6c41cd-6756-4b97-bb97-5e7b5b30ad2a req-5126ce85-7fa1-4d04-9908-e00bd66be95e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034477 Sep 02 17:10:44.012754 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 205/395] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:10:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:10:44.217564 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-9f708bd5-8313-4528-9ed4-1c4146e99112 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:44.218367 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-9f708bd5-8313-4528-9ed4-1c4146e99112 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] [instance: 5bb3c756-c618-430e-8157-87b5f85b7df5] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:44.224989 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9f708bd5-8313-4528-9ed4-1c4146e99112 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:44.225364 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9f708bd5-8313-4528-9ed4-1c4146e99112 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:44.226141 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9f708bd5-8313-4528-9ed4-1c4146e99112 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:44.226572 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9f708bd5-8313-4528-9ed4-1c4146e99112 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:44.380771 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-9f708bd5-8313-4528-9ed4-1c4146e99112 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccfbcc47ac249eab55ef847b69af3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd359d9fe04534460a1a5f839298fc0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:44.389640 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-9f708bd5-8313-4528-9ed4-1c4146e99112 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] 10.222.0.41 "GET /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5" status: 200 len: 1315 microversion: 2.1 time: 0.176053 Sep 02 17:10:44.390203 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 206/396] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:44 2021] GET /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:10:44.394468 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-a51cd994-5009-477d-9972-fc6d526354dd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:44.395410 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-a51cd994-5009-477d-9972-fc6d526354dd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:44.401520 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a51cd994-5009-477d-9972-fc6d526354dd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:44.401966 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a51cd994-5009-477d-9972-fc6d526354dd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:44.402793 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a51cd994-5009-477d-9972-fc6d526354dd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:44.403597 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a51cd994-5009-477d-9972-fc6d526354dd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:44.849975 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-a51cd994-5009-477d-9972-fc6d526354dd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 29364 microversion: 2.1 time: 0.458495 Sep 02 17:10:44.851301 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 207/397] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:44 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 29364 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:10:44.856353 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-1e037c0d-b10d-48f5-994c-d9a39c12e4cb tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:44.857332 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-1e037c0d-b10d-48f5-994c-d9a39c12e4cb tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:44.864005 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1e037c0d-b10d-48f5-994c-d9a39c12e4cb tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:44.864453 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1e037c0d-b10d-48f5-994c-d9a39c12e4cb tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:44.865309 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1e037c0d-b10d-48f5-994c-d9a39c12e4cb tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:44.865790 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1e037c0d-b10d-48f5-994c-d9a39c12e4cb tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:44.984479 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-1e037c0d-b10d-48f5-994c-d9a39c12e4cb tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 29883 microversion: 2.20 time: 0.131567 Sep 02 17:10:44.985042 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 208/398] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:10:44 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 29883 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:10:44.990233 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-55f9d7b9-f537-437a-af3e-9308e94be800 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:44.990986 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-55f9d7b9-f537-437a-af3e-9308e94be800 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:44.997578 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-55f9d7b9-f537-437a-af3e-9308e94be800 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:44.998026 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-55f9d7b9-f537-437a-af3e-9308e94be800 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:44.998830 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-55f9d7b9-f537-437a-af3e-9308e94be800 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:44.999262 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-55f9d7b9-f537-437a-af3e-9308e94be800 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:45.133685 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-55f9d7b9-f537-437a-af3e-9308e94be800 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:45.141203 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-55f9d7b9-f537-437a-af3e-9308e94be800 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1522 microversion: 2.1 time: 0.154643 Sep 02 17:10:45.141772 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 209/399] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:44 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:45.406353 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-1891d875-23aa-44ad-9d03-d12b74c0dd80 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:45.407107 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-1891d875-23aa-44ad-9d03-d12b74c0dd80 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] [instance: 5bb3c756-c618-430e-8157-87b5f85b7df5] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:45.412803 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1891d875-23aa-44ad-9d03-d12b74c0dd80 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:45.413825 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1891d875-23aa-44ad-9d03-d12b74c0dd80 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:45.414596 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1891d875-23aa-44ad-9d03-d12b74c0dd80 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:45.415054 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1891d875-23aa-44ad-9d03-d12b74c0dd80 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:45.546872 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-1891d875-23aa-44ad-9d03-d12b74c0dd80 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccfbcc47ac249eab55ef847b69af3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd359d9fe04534460a1a5f839298fc0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:45.554493 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-1891d875-23aa-44ad-9d03-d12b74c0dd80 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] 10.222.0.41 "GET /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5" status: 200 len: 1315 microversion: 2.1 time: 0.151726 Sep 02 17:10:45.555272 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 210/400] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:45 2021] GET /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:10:45.861848 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-b2a89e2c-71b9-465a-a60b-187dd2ecb9f7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:45.862780 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-b2a89e2c-71b9-465a-a60b-187dd2ecb9f7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:45.869154 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b2a89e2c-71b9-465a-a60b-187dd2ecb9f7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:45.869599 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b2a89e2c-71b9-465a-a60b-187dd2ecb9f7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:45.870430 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b2a89e2c-71b9-465a-a60b-187dd2ecb9f7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:45.871075 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b2a89e2c-71b9-465a-a60b-187dd2ecb9f7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:47.094483 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.network.neutron [None req-540f6ed6-be5d-4399-8fb0-a4892f6f9b52 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] validate_networks() for [('42e64c23-8d50-4a89-acaf-802979ed9882', None, None, None, None, None)] {{(pid=108418) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 17:10:47.465566 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-540f6ed6-be5d-4399-8fb0-a4892f6f9b52 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Flavor limits 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 17:10:47.466017 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-540f6ed6-be5d-4399-8fb0-a4892f6f9b52 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Image limits 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 17:10:47.466485 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-540f6ed6-be5d-4399-8fb0-a4892f6f9b52 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Flavor pref 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 17:10:47.466920 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-540f6ed6-be5d-4399-8fb0-a4892f6f9b52 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Image pref 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 17:10:47.467324 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-540f6ed6-be5d-4399-8fb0-a4892f6f9b52 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 17:10:47.475780 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-540f6ed6-be5d-4399-8fb0-a4892f6f9b52 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:47.476227 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-540f6ed6-be5d-4399-8fb0-a4892f6f9b52 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:47.477014 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-540f6ed6-be5d-4399-8fb0-a4892f6f9b52 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:47.477500 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-540f6ed6-be5d-4399-8fb0-a4892f6f9b52 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:47.493664 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.quota [None req-540f6ed6-be5d-4399-8fb0-a4892f6f9b52 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Getting quotas for project 9ec1c77ded4a41158a99f6cf578e395e. Resources: {'instances', 'cores', 'ram'} {{(pid=108418) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 17:10:47.497554 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.quota [None req-540f6ed6-be5d-4399-8fb0-a4892f6f9b52 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Getting quotas for user 86d5b6fd03e140b3bfbfef7a087063ec and project 9ec1c77ded4a41158a99f6cf578e395e. Resources: {'instances', 'cores', 'ram'} {{(pid=108418) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 17:10:47.508891 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-540f6ed6-be5d-4399-8fb0-a4892f6f9b52 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Going to run 1 instances... {{(pid=108418) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 17:10:47.511194 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-540f6ed6-be5d-4399-8fb0-a4892f6f9b52 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 422ee9ba-ea68-49c1-8704-16f3da2e809c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22ce6e29-f3a7-49f0-b93a-ddbffa14e44e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108418) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 17:10:47.560131 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-540f6ed6-be5d-4399-8fb0-a4892f6f9b52 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.822273 Sep 02 17:10:47.565523 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 191/401] 10.222.0.41 () {60 vars in 1147 bytes} [Thu Sep 2 17:10:41 2021] POST /compute/v2.1/servers => generated 380 bytes in 5824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 17:10:47.565523 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-d6f4e71a-2a2f-4fa2-977b-031ad6b0c6f3 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:47.566327 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-d6f4e71a-2a2f-4fa2-977b-031ad6b0c6f3 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:47.572667 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d6f4e71a-2a2f-4fa2-977b-031ad6b0c6f3 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:47.573116 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d6f4e71a-2a2f-4fa2-977b-031ad6b0c6f3 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:47.573884 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d6f4e71a-2a2f-4fa2-977b-031ad6b0c6f3 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:47.574318 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d6f4e71a-2a2f-4fa2-977b-031ad6b0c6f3 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:48.797568 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-d6f4e71a-2a2f-4fa2-977b-031ad6b0c6f3 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 32698 microversion: 2.20 time: 1.235517 Sep 02 17:10:48.798465 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 192/402] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:10:47 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 32698 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:10:48.803710 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-d7eae184-f0d7-4338-9338-7ddb28cfb8ed tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:48.804295 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-d7eae184-f0d7-4338-9338-7ddb28cfb8ed tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:48.810850 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d7eae184-f0d7-4338-9338-7ddb28cfb8ed tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:48.811305 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d7eae184-f0d7-4338-9338-7ddb28cfb8ed tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:48.812093 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d7eae184-f0d7-4338-9338-7ddb28cfb8ed tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:48.812527 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d7eae184-f0d7-4338-9338-7ddb28cfb8ed tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:48.886643 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-b2a89e2c-71b9-465a-a60b-187dd2ecb9f7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 33695 microversion: 2.1 time: 3.028530 Sep 02 17:10:48.887392 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 211/403] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:45 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 33695 bytes in 3030 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:10:48.893661 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-65d635f3-177c-460b-8693-cddc0f290fbe tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:48.894444 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-65d635f3-177c-460b-8693-cddc0f290fbe tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] [instance: 5bb3c756-c618-430e-8157-87b5f85b7df5] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:48.901901 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-65d635f3-177c-460b-8693-cddc0f290fbe tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:48.902444 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-65d635f3-177c-460b-8693-cddc0f290fbe tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:48.903141 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-65d635f3-177c-460b-8693-cddc0f290fbe tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:48.903763 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-65d635f3-177c-460b-8693-cddc0f290fbe tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:48.958425 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-d7eae184-f0d7-4338-9338-7ddb28cfb8ed tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:48.966808 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-d7eae184-f0d7-4338-9338-7ddb28cfb8ed tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1522 microversion: 2.1 time: 0.166972 Sep 02 17:10:48.967373 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 193/404] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:48 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:48.972397 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-3bae4664-fbdc-4b01-a156-1d1745110018 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:48.973314 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-3bae4664-fbdc-4b01-a156-1d1745110018 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 422ee9ba-ea68-49c1-8704-16f3da2e809c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:48.979512 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3bae4664-fbdc-4b01-a156-1d1745110018 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:48.980195 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3bae4664-fbdc-4b01-a156-1d1745110018 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:48.980974 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3bae4664-fbdc-4b01-a156-1d1745110018 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:48.981444 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3bae4664-fbdc-4b01-a156-1d1745110018 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:49.050989 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-3bae4664-fbdc-4b01-a156-1d1745110018 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:49.060323 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-3bae4664-fbdc-4b01-a156-1d1745110018 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c" status: 200 len: 1214 microversion: 2.1 time: 0.091423 Sep 02 17:10:49.061005 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 194/405] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:48 2021] GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:49.131365 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-65d635f3-177c-460b-8693-cddc0f290fbe tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccfbcc47ac249eab55ef847b69af3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd359d9fe04534460a1a5f839298fc0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:49.142361 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-65d635f3-177c-460b-8693-cddc0f290fbe tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] 10.222.0.41 "GET /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5" status: 200 len: 1315 microversion: 2.1 time: 0.253671 Sep 02 17:10:49.143311 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 212/406] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:48 2021] GET /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:49.810263 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-2822c899-c160-4eb8-a073-f2b0635b3094 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:49.811432 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-2822c899-c160-4eb8-a073-f2b0635b3094 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:49.817303 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2822c899-c160-4eb8-a073-f2b0635b3094 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:49.817751 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2822c899-c160-4eb8-a073-f2b0635b3094 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:49.818522 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2822c899-c160-4eb8-a073-f2b0635b3094 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:49.818983 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2822c899-c160-4eb8-a073-f2b0635b3094 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:49.898612 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-7c5da1f7-42d1-417c-bb24-76055c358e83 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:49.899562 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-7c5da1f7-42d1-417c-bb24-76055c358e83 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:49.906231 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7c5da1f7-42d1-417c-bb24-76055c358e83 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:49.906720 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7c5da1f7-42d1-417c-bb24-76055c358e83 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:49.909119 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7c5da1f7-42d1-417c-bb24-76055c358e83 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:49.909119 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7c5da1f7-42d1-417c-bb24-76055c358e83 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:50.130464 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-2822c899-c160-4eb8-a073-f2b0635b3094 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 33011 microversion: 2.20 time: 0.324266 Sep 02 17:10:50.135800 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 195/407] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:10:49 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 33011 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:10:50.141986 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-4e962fc6-141b-4ea5-be19-568a8e3331e4 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:50.142656 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-4e962fc6-141b-4ea5-be19-568a8e3331e4 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:50.153563 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4e962fc6-141b-4ea5-be19-568a8e3331e4 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:50.154173 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4e962fc6-141b-4ea5-be19-568a8e3331e4 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:50.155928 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4e962fc6-141b-4ea5-be19-568a8e3331e4 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:50.155928 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4e962fc6-141b-4ea5-be19-568a8e3331e4 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:50.157937 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-7c5da1f7-42d1-417c-bb24-76055c358e83 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 34157 microversion: 2.1 time: 0.262877 Sep 02 17:10:50.158573 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 213/408] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:49 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 34157 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:10:50.171163 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-e3cdbd78-d15d-44bc-ada1-4ac560dbb993 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:50.172186 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-e3cdbd78-d15d-44bc-ada1-4ac560dbb993 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 422ee9ba-ea68-49c1-8704-16f3da2e809c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:50.182739 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e3cdbd78-d15d-44bc-ada1-4ac560dbb993 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:50.183264 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e3cdbd78-d15d-44bc-ada1-4ac560dbb993 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:50.189905 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e3cdbd78-d15d-44bc-ada1-4ac560dbb993 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:50.190428 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e3cdbd78-d15d-44bc-ada1-4ac560dbb993 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:50.302523 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-e3cdbd78-d15d-44bc-ada1-4ac560dbb993 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:50.310333 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-e3cdbd78-d15d-44bc-ada1-4ac560dbb993 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c" status: 200 len: 1288 microversion: 2.1 time: 0.150546 Sep 02 17:10:50.315035 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 214/409] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:50 2021] GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c => generated 1288 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:50.320377 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-fb5cc530-1c8d-477c-957d-1b214f9a88f4 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:50.321252 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-fb5cc530-1c8d-477c-957d-1b214f9a88f4 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] [instance: 5bb3c756-c618-430e-8157-87b5f85b7df5] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:50.328351 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fb5cc530-1c8d-477c-957d-1b214f9a88f4 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:50.329288 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fb5cc530-1c8d-477c-957d-1b214f9a88f4 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:50.330408 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fb5cc530-1c8d-477c-957d-1b214f9a88f4 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:50.331351 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fb5cc530-1c8d-477c-957d-1b214f9a88f4 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:50.356849 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-4e962fc6-141b-4ea5-be19-568a8e3331e4 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:50.365066 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-4e962fc6-141b-4ea5-be19-568a8e3331e4 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1522 microversion: 2.1 time: 0.232455 Sep 02 17:10:50.365706 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 196/410] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:50 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:50.534715 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-fb5cc530-1c8d-477c-957d-1b214f9a88f4 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccfbcc47ac249eab55ef847b69af3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd359d9fe04534460a1a5f839298fc0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:50.551798 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-fb5cc530-1c8d-477c-957d-1b214f9a88f4 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] 10.222.0.41 "GET /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5" status: 200 len: 1464 microversion: 2.1 time: 0.235432 Sep 02 17:10:50.552323 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 215/411] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:50 2021] GET /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5 => generated 1464 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:50.592420 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-3933a0ec-4a01-42f6-8107-39449ca92ae6 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:50.592729 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-3933a0ec-4a01-42f6-8107-39449ca92ae6 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] [instance: 5bb3c756-c618-430e-8157-87b5f85b7df5] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:50.599234 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3933a0ec-4a01-42f6-8107-39449ca92ae6 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:50.599710 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3933a0ec-4a01-42f6-8107-39449ca92ae6 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:50.600531 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3933a0ec-4a01-42f6-8107-39449ca92ae6 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:50.600958 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3933a0ec-4a01-42f6-8107-39449ca92ae6 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:50.633752 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-3933a0ec-4a01-42f6-8107-39449ca92ae6 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] [instance: 5bb3c756-c618-430e-8157-87b5f85b7df5] Going to try to terminate instance {{(pid=108418) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 17:10:50.729918 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-3933a0ec-4a01-42f6-8107-39449ca92ae6 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] 10.222.0.41 "DELETE /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5" status: 204 len: 0 microversion: 2.1 time: 0.140973 Sep 02 17:10:50.730485 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 197/412] 10.222.0.41 () {58 vars in 1239 bytes} [Thu Sep 2 17:10:50 2021] DELETE /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 17:10:50.739392 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-28cea5d2-5b17-42df-b169-1f72bed0eb66 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:50.741013 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-28cea5d2-5b17-42df-b169-1f72bed0eb66 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] [instance: 5bb3c756-c618-430e-8157-87b5f85b7df5] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:50.748635 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-28cea5d2-5b17-42df-b169-1f72bed0eb66 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:50.749584 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-28cea5d2-5b17-42df-b169-1f72bed0eb66 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:50.750855 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-28cea5d2-5b17-42df-b169-1f72bed0eb66 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:50.751915 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-28cea5d2-5b17-42df-b169-1f72bed0eb66 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:50.923740 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-28cea5d2-5b17-42df-b169-1f72bed0eb66 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccfbcc47ac249eab55ef847b69af3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd359d9fe04534460a1a5f839298fc0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:50.931576 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-28cea5d2-5b17-42df-b169-1f72bed0eb66 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] 10.222.0.41 "GET /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5" status: 200 len: 1470 microversion: 2.1 time: 0.196414 Sep 02 17:10:50.932579 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 216/413] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:50 2021] GET /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5 => generated 1470 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:51.147433 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-25fed76d-34d6-4a23-b9c6-09f3b8b5f02f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:51.150155 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-25fed76d-34d6-4a23-b9c6-09f3b8b5f02f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:51.159860 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-25fed76d-34d6-4a23-b9c6-09f3b8b5f02f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:51.160616 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-25fed76d-34d6-4a23-b9c6-09f3b8b5f02f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:51.161398 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-25fed76d-34d6-4a23-b9c6-09f3b8b5f02f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:51.161830 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-25fed76d-34d6-4a23-b9c6-09f3b8b5f02f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:51.170306 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-84477314-fbfc-439c-b6f3-1ae94c60ddec tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:51.171798 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-84477314-fbfc-439c-b6f3-1ae94c60ddec tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:51.182037 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-84477314-fbfc-439c-b6f3-1ae94c60ddec tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:51.183526 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-84477314-fbfc-439c-b6f3-1ae94c60ddec tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:51.185352 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-84477314-fbfc-439c-b6f3-1ae94c60ddec tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:51.186134 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-84477314-fbfc-439c-b6f3-1ae94c60ddec tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:51.385041 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-25fed76d-34d6-4a23-b9c6-09f3b8b5f02f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 33144 microversion: 2.20 time: 0.244931 Sep 02 17:10:51.385589 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 198/414] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:10:51 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 33144 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:10:51.390788 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-97723a96-7eeb-4802-b81f-1f27850fdd09 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:51.391480 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-97723a96-7eeb-4802-b81f-1f27850fdd09 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 422ee9ba-ea68-49c1-8704-16f3da2e809c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:51.398126 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-97723a96-7eeb-4802-b81f-1f27850fdd09 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:51.398572 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-97723a96-7eeb-4802-b81f-1f27850fdd09 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:51.399843 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-97723a96-7eeb-4802-b81f-1f27850fdd09 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:51.399843 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-97723a96-7eeb-4802-b81f-1f27850fdd09 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:51.434419 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-84477314-fbfc-439c-b6f3-1ae94c60ddec tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 34394 microversion: 2.1 time: 0.268085 Sep 02 17:10:51.435719 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 217/415] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:51 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 34394 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:10:51.442524 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-f31aeb1b-02a9-4bc9-873e-2adaa065dc94 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:51.443267 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-f31aeb1b-02a9-4bc9-873e-2adaa065dc94 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:51.449689 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f31aeb1b-02a9-4bc9-873e-2adaa065dc94 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:51.450161 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f31aeb1b-02a9-4bc9-873e-2adaa065dc94 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:51.450975 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f31aeb1b-02a9-4bc9-873e-2adaa065dc94 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:51.451414 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f31aeb1b-02a9-4bc9-873e-2adaa065dc94 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:51.527825 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-97723a96-7eeb-4802-b81f-1f27850fdd09 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:51.535779 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-97723a96-7eeb-4802-b81f-1f27850fdd09 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c" status: 200 len: 1318 microversion: 2.1 time: 0.148755 Sep 02 17:10:51.536366 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 199/416] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:51 2021] GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:51.881470 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-f31aeb1b-02a9-4bc9-873e-2adaa065dc94 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:51.889974 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-f31aeb1b-02a9-4bc9-873e-2adaa065dc94 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1522 microversion: 2.1 time: 0.452092 Sep 02 17:10:51.890533 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 218/417] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:51 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1522 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:51.950396 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-66214970-5f58-4549-ba8e-759def993104 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:51.951445 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-66214970-5f58-4549-ba8e-759def993104 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] [instance: 5bb3c756-c618-430e-8157-87b5f85b7df5] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:51.960109 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-66214970-5f58-4549-ba8e-759def993104 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:51.960757 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-66214970-5f58-4549-ba8e-759def993104 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:51.961576 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-66214970-5f58-4549-ba8e-759def993104 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:51.962279 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-66214970-5f58-4549-ba8e-759def993104 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:52.056135 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [req-c68e26b4-edee-48cf-8c07-8021fde304bd req-082dbb84-db1e-46ed-8623-1a4cb77900ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "422ee9ba-ea68-49c1-8704-16f3da2e809c", "tag": "b84c05c6-edce-4eb5-954d-fdf2e1e3e9a1"}]} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:52.058365 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:10:52.058365 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: warnings.warn(msg) Sep 02 17:10:52.065597 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-c68e26b4-edee-48cf-8c07-8021fde304bd req-082dbb84-db1e-46ed-8623-1a4cb77900ac service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:52.066030 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-c68e26b4-edee-48cf-8c07-8021fde304bd req-082dbb84-db1e-46ed-8623-1a4cb77900ac service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:52.077919 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.compute.server_external_events [req-c68e26b4-edee-48cf-8c07-8021fde304bd req-082dbb84-db1e-46ed-8623-1a4cb77900ac service nova] Creating event network-changed:b84c05c6-edce-4eb5-954d-fdf2e1e3e9a1 for instance 422ee9ba-ea68-49c1-8704-16f3da2e809c on hv-cinder-80626 Sep 02 17:10:52.083028 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [req-c68e26b4-edee-48cf-8c07-8021fde304bd req-082dbb84-db1e-46ed-8623-1a4cb77900ac service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030550 Sep 02 17:10:52.083392 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 219/418] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:10:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:10:52.096632 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-66214970-5f58-4549-ba8e-759def993104 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccfbcc47ac249eab55ef847b69af3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd359d9fe04534460a1a5f839298fc0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:52.103933 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-66214970-5f58-4549-ba8e-759def993104 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] 10.222.0.41 "GET /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5" status: 200 len: 1470 microversion: 2.1 time: 0.159410 Sep 02 17:10:52.104792 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 200/419] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:51 2021] GET /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5 => generated 1470 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:52.397107 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-de0ac438-8108-4633-95dc-52c5e8830f4d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:52.398105 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-de0ac438-8108-4633-95dc-52c5e8830f4d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:52.404672 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-de0ac438-8108-4633-95dc-52c5e8830f4d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:52.405123 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-de0ac438-8108-4633-95dc-52c5e8830f4d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:52.405891 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-de0ac438-8108-4633-95dc-52c5e8830f4d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:52.406378 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-de0ac438-8108-4633-95dc-52c5e8830f4d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:52.447110 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-1fd30705-98c3-42d0-abec-9a521e5572b6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:52.448072 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-1fd30705-98c3-42d0-abec-9a521e5572b6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:52.454331 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1fd30705-98c3-42d0-abec-9a521e5572b6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:52.454749 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1fd30705-98c3-42d0-abec-9a521e5572b6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:52.455517 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1fd30705-98c3-42d0-abec-9a521e5572b6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:52.455952 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1fd30705-98c3-42d0-abec-9a521e5572b6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:52.672449 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-de0ac438-8108-4633-95dc-52c5e8830f4d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 33363 microversion: 2.20 time: 0.279317 Sep 02 17:10:52.673089 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 220/420] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:10:52 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 33363 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:10:52.678088 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-e6cd85f2-1612-4ab6-9076-7580420095e8 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:52.679380 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-e6cd85f2-1612-4ab6-9076-7580420095e8 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 422ee9ba-ea68-49c1-8704-16f3da2e809c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:52.685803 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e6cd85f2-1612-4ab6-9076-7580420095e8 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:52.686252 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e6cd85f2-1612-4ab6-9076-7580420095e8 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:52.687227 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e6cd85f2-1612-4ab6-9076-7580420095e8 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:52.687662 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e6cd85f2-1612-4ab6-9076-7580420095e8 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:52.778347 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-1fd30705-98c3-42d0-abec-9a521e5572b6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 34587 microversion: 2.1 time: 0.335354 Sep 02 17:10:52.782315 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 201/421] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:52 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 34587 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:10:52.844123 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-e6cd85f2-1612-4ab6-9076-7580420095e8 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:52.851997 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-e6cd85f2-1612-4ab6-9076-7580420095e8 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c" status: 200 len: 1318 microversion: 2.1 time: 0.177625 Sep 02 17:10:52.852553 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 221/422] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:52 2021] GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:52.908963 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-90d0cb65-361c-4e9f-a37a-a8be75c89b3f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:52.909691 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-90d0cb65-361c-4e9f-a37a-a8be75c89b3f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:52.916081 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-90d0cb65-361c-4e9f-a37a-a8be75c89b3f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:52.916521 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-90d0cb65-361c-4e9f-a37a-a8be75c89b3f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:52.917504 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-90d0cb65-361c-4e9f-a37a-a8be75c89b3f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:52.917937 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-90d0cb65-361c-4e9f-a37a-a8be75c89b3f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:53.091806 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-90d0cb65-361c-4e9f-a37a-a8be75c89b3f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:53.099083 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-90d0cb65-361c-4e9f-a37a-a8be75c89b3f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1522 microversion: 2.1 time: 0.194724 Sep 02 17:10:53.101601 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 202/423] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:52 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:53.121930 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-9a06304e-c9b6-401a-9041-6d8c3cbe1d17 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:53.122528 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-9a06304e-c9b6-401a-9041-6d8c3cbe1d17 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] [instance: 5bb3c756-c618-430e-8157-87b5f85b7df5] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:53.128751 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9a06304e-c9b6-401a-9041-6d8c3cbe1d17 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:53.129342 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9a06304e-c9b6-401a-9041-6d8c3cbe1d17 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:53.130113 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9a06304e-c9b6-401a-9041-6d8c3cbe1d17 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:53.130552 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9a06304e-c9b6-401a-9041-6d8c3cbe1d17 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:53.283503 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-9a06304e-c9b6-401a-9041-6d8c3cbe1d17 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccfbcc47ac249eab55ef847b69af3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd359d9fe04534460a1a5f839298fc0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:53.291060 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-9a06304e-c9b6-401a-9041-6d8c3cbe1d17 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] 10.222.0.41 "GET /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5" status: 200 len: 1470 microversion: 2.1 time: 0.172691 Sep 02 17:10:53.291623 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 222/424] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:53 2021] GET /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5 => generated 1470 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:53.685048 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-90d5847d-fd10-4d99-a0eb-a354e871e1e6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:53.685945 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-90d5847d-fd10-4d99-a0eb-a354e871e1e6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:53.691761 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-90d5847d-fd10-4d99-a0eb-a354e871e1e6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:53.692196 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-90d5847d-fd10-4d99-a0eb-a354e871e1e6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:53.692956 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-90d5847d-fd10-4d99-a0eb-a354e871e1e6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:53.693381 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-90d5847d-fd10-4d99-a0eb-a354e871e1e6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:53.790491 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-dfee6bea-43aa-423d-ac90-0b0cfe662e50 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:53.791504 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-dfee6bea-43aa-423d-ac90-0b0cfe662e50 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:53.797775 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-dfee6bea-43aa-423d-ac90-0b0cfe662e50 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:53.798220 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-dfee6bea-43aa-423d-ac90-0b0cfe662e50 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:53.799016 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-dfee6bea-43aa-423d-ac90-0b0cfe662e50 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:53.799453 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-dfee6bea-43aa-423d-ac90-0b0cfe662e50 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:54.036470 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-dfee6bea-43aa-423d-ac90-0b0cfe662e50 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 35865 microversion: 2.1 time: 0.249998 Sep 02 17:10:54.037018 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 223/425] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:53 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 35865 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:10:54.042478 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-90c454b2-4b81-43e8-b032-d9929d00abec tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:54.043185 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-90c454b2-4b81-43e8-b032-d9929d00abec tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 422ee9ba-ea68-49c1-8704-16f3da2e809c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:54.049558 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-90c454b2-4b81-43e8-b032-d9929d00abec tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:54.049996 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-90c454b2-4b81-43e8-b032-d9929d00abec tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:54.050786 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-90c454b2-4b81-43e8-b032-d9929d00abec tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:54.051220 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-90c454b2-4b81-43e8-b032-d9929d00abec tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:54.095926 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-90d5847d-fd10-4d99-a0eb-a354e871e1e6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 33787 microversion: 2.20 time: 0.414227 Sep 02 17:10:54.097525 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 203/426] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:10:53 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 33787 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:10:54.120150 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-ef075a75-e7f3-457c-98c7-73a1e3f56bac tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:54.120853 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-ef075a75-e7f3-457c-98c7-73a1e3f56bac tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:54.128098 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ef075a75-e7f3-457c-98c7-73a1e3f56bac tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:54.128554 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ef075a75-e7f3-457c-98c7-73a1e3f56bac tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:54.129417 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ef075a75-e7f3-457c-98c7-73a1e3f56bac tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:54.129862 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ef075a75-e7f3-457c-98c7-73a1e3f56bac tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:54.187886 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-90c454b2-4b81-43e8-b032-d9929d00abec tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:54.196180 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-90c454b2-4b81-43e8-b032-d9929d00abec tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c" status: 200 len: 1318 microversion: 2.1 time: 0.157997 Sep 02 17:10:54.196963 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 224/427] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:54 2021] GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:54.269055 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-ef075a75-e7f3-457c-98c7-73a1e3f56bac tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:54.278182 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-ef075a75-e7f3-457c-98c7-73a1e3f56bac tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1522 microversion: 2.1 time: 0.162349 Sep 02 17:10:54.278850 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 204/428] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:54 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:10:54.307881 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-d798abdc-bfea-4f72-86fd-97e6848285a1 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:54.308507 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-d798abdc-bfea-4f72-86fd-97e6848285a1 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] [instance: 5bb3c756-c618-430e-8157-87b5f85b7df5] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:54.314159 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d798abdc-bfea-4f72-86fd-97e6848285a1 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:54.314698 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d798abdc-bfea-4f72-86fd-97e6848285a1 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:54.315402 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d798abdc-bfea-4f72-86fd-97e6848285a1 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:54.315839 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d798abdc-bfea-4f72-86fd-97e6848285a1 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:54.451269 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-d798abdc-bfea-4f72-86fd-97e6848285a1 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccfbcc47ac249eab55ef847b69af3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd359d9fe04534460a1a5f839298fc0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:54.459310 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-d798abdc-bfea-4f72-86fd-97e6848285a1 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] 10.222.0.41 "GET /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5" status: 200 len: 1470 microversion: 2.1 time: 0.155091 Sep 02 17:10:54.460637 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 225/429] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:54 2021] GET /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5 => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:55.048862 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-e38311ad-ab10-4c05-9581-12af8d2bb0ca tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:55.049767 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-e38311ad-ab10-4c05-9581-12af8d2bb0ca tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:55.056270 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e38311ad-ab10-4c05-9581-12af8d2bb0ca tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:55.056744 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e38311ad-ab10-4c05-9581-12af8d2bb0ca tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:55.057584 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e38311ad-ab10-4c05-9581-12af8d2bb0ca tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:55.058050 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e38311ad-ab10-4c05-9581-12af8d2bb0ca tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:55.107653 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-e9919831-04bc-4c70-81c2-4acfdfb2fb11 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:55.108600 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-e9919831-04bc-4c70-81c2-4acfdfb2fb11 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:55.115453 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e9919831-04bc-4c70-81c2-4acfdfb2fb11 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:55.116629 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e9919831-04bc-4c70-81c2-4acfdfb2fb11 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:55.117576 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e9919831-04bc-4c70-81c2-4acfdfb2fb11 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:55.118145 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e9919831-04bc-4c70-81c2-4acfdfb2fb11 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:55.448817 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-e38311ad-ab10-4c05-9581-12af8d2bb0ca tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 36314 microversion: 2.1 time: 0.403460 Sep 02 17:10:55.449927 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 205/430] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:55 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 36314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:10:55.455610 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-2ac3ac4b-ed2e-4c9f-8a77-5106b1a1d219 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:55.456226 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-2ac3ac4b-ed2e-4c9f-8a77-5106b1a1d219 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 422ee9ba-ea68-49c1-8704-16f3da2e809c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:55.463005 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2ac3ac4b-ed2e-4c9f-8a77-5106b1a1d219 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:55.463462 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2ac3ac4b-ed2e-4c9f-8a77-5106b1a1d219 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:55.464300 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2ac3ac4b-ed2e-4c9f-8a77-5106b1a1d219 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:55.464715 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2ac3ac4b-ed2e-4c9f-8a77-5106b1a1d219 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:55.585378 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-e9919831-04bc-4c70-81c2-4acfdfb2fb11 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 34541 microversion: 2.20 time: 0.480800 Sep 02 17:10:55.586177 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 226/431] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:10:55 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 34541 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:10:55.594997 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-e899c0ad-5d21-43da-bdad-6e3be05f9e0b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:55.595719 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-e899c0ad-5d21-43da-bdad-6e3be05f9e0b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:55.603180 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e899c0ad-5d21-43da-bdad-6e3be05f9e0b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:55.603629 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e899c0ad-5d21-43da-bdad-6e3be05f9e0b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:55.604399 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e899c0ad-5d21-43da-bdad-6e3be05f9e0b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:55.605034 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e899c0ad-5d21-43da-bdad-6e3be05f9e0b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:55.661412 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-2ac3ac4b-ed2e-4c9f-8a77-5106b1a1d219 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:55.669064 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-2ac3ac4b-ed2e-4c9f-8a77-5106b1a1d219 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c" status: 200 len: 1318 microversion: 2.1 time: 0.217852 Sep 02 17:10:55.670065 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 206/432] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:55 2021] GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:55.674768 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-194af975-2eff-4b42-bcb8-d73c428e1e51 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:55.675794 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-194af975-2eff-4b42-bcb8-d73c428e1e51 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] [instance: 5bb3c756-c618-430e-8157-87b5f85b7df5] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:55.683816 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-194af975-2eff-4b42-bcb8-d73c428e1e51 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:55.684570 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-194af975-2eff-4b42-bcb8-d73c428e1e51 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:55.685524 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-194af975-2eff-4b42-bcb8-d73c428e1e51 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:55.686313 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-194af975-2eff-4b42-bcb8-d73c428e1e51 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:55.765409 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-e899c0ad-5d21-43da-bdad-6e3be05f9e0b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:55.776360 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-e899c0ad-5d21-43da-bdad-6e3be05f9e0b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1522 microversion: 2.1 time: 0.185371 Sep 02 17:10:55.786169 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 227/433] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:55 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:55.827154 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-e323e9b0-02a7-45aa-98b2-189c1e4a7191 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "096e3897-06d4-4339-9ff5-bd167f49e30b", "device": "/dev/sdb"}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:55.828791 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-e323e9b0-02a7-45aa-98b2-189c1e4a7191 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 90cb7d6a-93e4-427e-bdba-de422d89fa0f] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:55.836602 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e323e9b0-02a7-45aa-98b2-189c1e4a7191 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:55.837456 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e323e9b0-02a7-45aa-98b2-189c1e4a7191 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:55.838562 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e323e9b0-02a7-45aa-98b2-189c1e4a7191 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:55.839028 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e323e9b0-02a7-45aa-98b2-189c1e4a7191 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:55.921998 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-194af975-2eff-4b42-bcb8-d73c428e1e51 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccfbcc47ac249eab55ef847b69af3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd359d9fe04534460a1a5f839298fc0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:55.934121 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-194af975-2eff-4b42-bcb8-d73c428e1e51 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] 10.222.0.41 "GET /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5" status: 200 len: 1470 microversion: 2.1 time: 0.262407 Sep 02 17:10:55.937664 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 207/434] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:55 2021] GET /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5 => generated 1470 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:56.126292 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-e323e9b0-02a7-45aa-98b2-189c1e4a7191 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "POST /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302823 Sep 02 17:10:56.127482 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 228/435] 10.222.0.41 () {60 vars in 1323 bytes} [Thu Sep 2 17:10:55 2021] POST /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:10:56.203984 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-907cffdf-d007-4f78-ac65-c8e7a2694482 req-36534df3-7e8b-41c8-a84a-85e62bf47c0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bb3c756-c618-430e-8157-87b5f85b7df5", "name": "network-vif-deleted", "tag": "82a098ff-909c-44a4-b1c8-8ba281c63868"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:56.205553 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:10:56.205553 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:10:56.216820 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-907cffdf-d007-4f78-ac65-c8e7a2694482 req-36534df3-7e8b-41c8-a84a-85e62bf47c0d service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:56.217301 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-907cffdf-d007-4f78-ac65-c8e7a2694482 req-36534df3-7e8b-41c8-a84a-85e62bf47c0d service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:56.235542 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-907cffdf-d007-4f78-ac65-c8e7a2694482 req-36534df3-7e8b-41c8-a84a-85e62bf47c0d service nova] Creating event network-vif-deleted:82a098ff-909c-44a4-b1c8-8ba281c63868 for instance 5bb3c756-c618-430e-8157-87b5f85b7df5 on hv-cinder-80626 Sep 02 17:10:56.242379 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-907cffdf-d007-4f78-ac65-c8e7a2694482 req-36534df3-7e8b-41c8-a84a-85e62bf47c0d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043095 Sep 02 17:10:56.243456 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 208/436] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:10:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:10:56.462778 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-b624e67a-8ee6-4ec0-bf1c-a15e8a7082b2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:56.463823 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-b624e67a-8ee6-4ec0-bf1c-a15e8a7082b2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:56.469771 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b624e67a-8ee6-4ec0-bf1c-a15e8a7082b2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:56.470218 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b624e67a-8ee6-4ec0-bf1c-a15e8a7082b2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:56.471026 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b624e67a-8ee6-4ec0-bf1c-a15e8a7082b2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:56.471461 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b624e67a-8ee6-4ec0-bf1c-a15e8a7082b2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:56.598552 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-4eacc798-e721-4705-8570-11a04dc9cdae tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:56.599625 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-4eacc798-e721-4705-8570-11a04dc9cdae tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:56.605828 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4eacc798-e721-4705-8570-11a04dc9cdae tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:56.606276 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4eacc798-e721-4705-8570-11a04dc9cdae tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:56.607076 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4eacc798-e721-4705-8570-11a04dc9cdae tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:56.607509 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4eacc798-e721-4705-8570-11a04dc9cdae tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:56.621977 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-b624e67a-8ee6-4ec0-bf1c-a15e8a7082b2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 37379 microversion: 2.1 time: 0.163593 Sep 02 17:10:56.622689 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 229/437] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:56 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 37379 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:10:56.685495 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-4aafb5cd-494b-4e4e-82d6-8bb343da724c tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:56.686201 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-4aafb5cd-494b-4e4e-82d6-8bb343da724c tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 422ee9ba-ea68-49c1-8704-16f3da2e809c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:56.692643 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4aafb5cd-494b-4e4e-82d6-8bb343da724c tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:56.693089 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4aafb5cd-494b-4e4e-82d6-8bb343da724c tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:56.694350 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4aafb5cd-494b-4e4e-82d6-8bb343da724c tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:56.694834 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4aafb5cd-494b-4e4e-82d6-8bb343da724c tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:56.762049 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-4eacc798-e721-4705-8570-11a04dc9cdae tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 37463 microversion: 2.20 time: 0.167871 Sep 02 17:10:56.762855 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 209/438] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:10:56 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 37463 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:10:56.793779 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-f438931f-e245-4cb1-a40d-f6ca7fa24ba8 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:56.794773 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-f438931f-e245-4cb1-a40d-f6ca7fa24ba8 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:56.801597 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f438931f-e245-4cb1-a40d-f6ca7fa24ba8 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:56.802297 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f438931f-e245-4cb1-a40d-f6ca7fa24ba8 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:56.803139 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f438931f-e245-4cb1-a40d-f6ca7fa24ba8 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:56.804239 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f438931f-e245-4cb1-a40d-f6ca7fa24ba8 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:56.824362 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-4aafb5cd-494b-4e4e-82d6-8bb343da724c tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:56.832056 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-4aafb5cd-494b-4e4e-82d6-8bb343da724c tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c" status: 200 len: 1318 microversion: 2.1 time: 0.150504 Sep 02 17:10:56.833172 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 230/439] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:56 2021] GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:10:56.931966 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-f438931f-e245-4cb1-a40d-f6ca7fa24ba8 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:56.939530 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-f438931f-e245-4cb1-a40d-f6ca7fa24ba8 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1502 microversion: 2.1 time: 0.149933 Sep 02 17:10:56.940081 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 210/440] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:56 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1502 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:10:56.954709 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-1e4f3ab1-05a4-46d0-bb4c-f929096eba5c tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:56.955341 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-1e4f3ab1-05a4-46d0-bb4c-f929096eba5c tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] [instance: 5bb3c756-c618-430e-8157-87b5f85b7df5] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:56.956151 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-ae1ceaa1-8b69-4575-b67e-1aacadf5bc88 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d86755b5-e335-41ef-8770-59273c188774"}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:56.957231 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-ae1ceaa1-8b69-4575-b67e-1aacadf5bc88 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:56.961176 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1e4f3ab1-05a4-46d0-bb4c-f929096eba5c tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:56.961610 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1e4f3ab1-05a4-46d0-bb4c-f929096eba5c tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:56.962365 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1e4f3ab1-05a4-46d0-bb4c-f929096eba5c tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:56.962841 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1e4f3ab1-05a4-46d0-bb4c-f929096eba5c tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:56.963665 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ae1ceaa1-8b69-4575-b67e-1aacadf5bc88 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:56.964116 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ae1ceaa1-8b69-4575-b67e-1aacadf5bc88 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:56.964879 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ae1ceaa1-8b69-4575-b67e-1aacadf5bc88 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:56.965634 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ae1ceaa1-8b69-4575-b67e-1aacadf5bc88 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:56.988802 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.wsgi [None req-ae1ceaa1-8b69-4575-b67e-1aacadf5bc88 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] HTTP exception thrown: Cannot 'attach_volume' instance 089cf4bd-25a6-4572-a20b-99c71430e5f8 while it is in vm_state rescued Sep 02 17:10:56.989389 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-ae1ceaa1-8b69-4575-b67e-1aacadf5bc88 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Returning 409 to user: Cannot 'attach_volume' instance 089cf4bd-25a6-4572-a20b-99c71430e5f8 while it is in vm_state rescued {{(pid=108418) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:10:56.990212 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-ae1ceaa1-8b69-4575-b67e-1aacadf5bc88 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "POST /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.037961 Sep 02 17:10:56.991461 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 211/441] 10.222.0.41 () {60 vars in 1323 bytes} [Thu Sep 2 17:10:56 2021] POST /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8/os-volume_attachments => generated 152 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 02 17:10:56.993091 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1e4f3ab1-05a4-46d0-bb4c-f929096eba5c tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:56.993529 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1e4f3ab1-05a4-46d0-bb4c-f929096eba5c tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:56.993969 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.objects.instance [None req-1e4f3ab1-05a4-46d0-bb4c-f929096eba5c tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lazy-loading 'fault' on Instance uuid 5bb3c756-c618-430e-8157-87b5f85b7df5 {{(pid=108417) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 17:10:56.999596 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-427f83da-2284-49e0-a9b9-c1599e2e27bf tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:57.000115 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-427f83da-2284-49e0-a9b9-c1599e2e27bf tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:57.005987 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-427f83da-2284-49e0-a9b9-c1599e2e27bf tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:57.007229 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-427f83da-2284-49e0-a9b9-c1599e2e27bf tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:57.008057 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-427f83da-2284-49e0-a9b9-c1599e2e27bf tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:57.008601 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-427f83da-2284-49e0-a9b9-c1599e2e27bf tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:57.033427 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-1e4f3ab1-05a4-46d0-bb4c-f929096eba5c tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ccfbcc47ac249eab55ef847b69af3d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd359d9fe04534460a1a5f839298fc0f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:57.040895 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-1e4f3ab1-05a4-46d0-bb4c-f929096eba5c tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] 10.222.0.41 "GET /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5" status: 200 len: 1305 microversion: 2.1 time: 0.090120 Sep 02 17:10:57.041469 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 231/442] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:56 2021] GET /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5 => generated 1305 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:57.080619 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-427f83da-2284-49e0-a9b9-c1599e2e27bf tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "POST /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8/action" status: 202 len: 0 microversion: 2.1 time: 0.084215 Sep 02 17:10:57.081512 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 212/443] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:56 2021] POST /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:10:57.089152 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-47de58b1-6d2f-4643-b85c-feca70e01bf3 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:57.089761 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-47de58b1-6d2f-4643-b85c-feca70e01bf3 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:57.096105 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-47de58b1-6d2f-4643-b85c-feca70e01bf3 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:57.096557 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-47de58b1-6d2f-4643-b85c-feca70e01bf3 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:57.097363 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-47de58b1-6d2f-4643-b85c-feca70e01bf3 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:57.097799 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-47de58b1-6d2f-4643-b85c-feca70e01bf3 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:57.239168 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-47de58b1-6d2f-4643-b85c-feca70e01bf3 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:57.249464 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-47de58b1-6d2f-4643-b85c-feca70e01bf3 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1510 microversion: 2.1 time: 0.163878 Sep 02 17:10:57.250390 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 232/444] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:57 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1510 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:57.633961 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-2a74d668-de39-43d8-99b7-c35c947b5a38 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:57.635183 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-2a74d668-de39-43d8-99b7-c35c947b5a38 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:57.642126 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2a74d668-de39-43d8-99b7-c35c947b5a38 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:57.642616 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2a74d668-de39-43d8-99b7-c35c947b5a38 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:57.643424 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2a74d668-de39-43d8-99b7-c35c947b5a38 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:57.643863 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2a74d668-de39-43d8-99b7-c35c947b5a38 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:57.768743 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-2a74d668-de39-43d8-99b7-c35c947b5a38 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 37848 microversion: 2.1 time: 0.138671 Sep 02 17:10:57.769380 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 213/445] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:57 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 37848 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:10:57.773686 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-79939bae-9cb9-42e7-9377-782b4b4a427a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:57.774743 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-79939bae-9cb9-42e7-9377-782b4b4a427a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:57.781037 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-79939bae-9cb9-42e7-9377-782b4b4a427a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:57.781478 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-79939bae-9cb9-42e7-9377-782b4b4a427a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:57.782246 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-79939bae-9cb9-42e7-9377-782b4b4a427a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:57.782694 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-79939bae-9cb9-42e7-9377-782b4b4a427a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:57.850846 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-48b30d02-06e1-4bf1-be6d-3aa05a5829f4 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:57.851702 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-48b30d02-06e1-4bf1-be6d-3aa05a5829f4 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 422ee9ba-ea68-49c1-8704-16f3da2e809c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:57.859289 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-48b30d02-06e1-4bf1-be6d-3aa05a5829f4 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:57.859775 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-48b30d02-06e1-4bf1-be6d-3aa05a5829f4 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:57.860570 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-48b30d02-06e1-4bf1-be6d-3aa05a5829f4 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:57.861274 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-48b30d02-06e1-4bf1-be6d-3aa05a5829f4 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:57.973223 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-79939bae-9cb9-42e7-9377-782b4b4a427a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 38036 microversion: 2.20 time: 0.203415 Sep 02 17:10:57.977498 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 233/446] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:10:57 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 38036 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:10:57.993150 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-48b30d02-06e1-4bf1-be6d-3aa05a5829f4 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:58.000444 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-48b30d02-06e1-4bf1-be6d-3aa05a5829f4 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c" status: 200 len: 1318 microversion: 2.1 time: 0.155334 Sep 02 17:10:58.001001 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 214/447] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:57 2021] GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:10:58.057596 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-5f6ff602-54ad-48d1-b8ff-96398839b453 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:58.058282 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-5f6ff602-54ad-48d1-b8ff-96398839b453 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] [instance: 5bb3c756-c618-430e-8157-87b5f85b7df5] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:58.064683 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5f6ff602-54ad-48d1-b8ff-96398839b453 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:58.065122 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5f6ff602-54ad-48d1-b8ff-96398839b453 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:58.065909 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5f6ff602-54ad-48d1-b8ff-96398839b453 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:58.066299 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5f6ff602-54ad-48d1-b8ff-96398839b453 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:58.079785 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.wsgi [None req-5f6ff602-54ad-48d1-b8ff-96398839b453 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] HTTP exception thrown: Instance 5bb3c756-c618-430e-8157-87b5f85b7df5 could not be found. Sep 02 17:10:58.080363 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-5f6ff602-54ad-48d1-b8ff-96398839b453 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] Returning 404 to user: Instance 5bb3c756-c618-430e-8157-87b5f85b7df5 could not be found. {{(pid=108417) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:10:58.081173 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-5f6ff602-54ad-48d1-b8ff-96398839b453 tempest-VolumesNegativeTest-23054934 tempest-VolumesNegativeTest-23054934-project] 10.222.0.41 "GET /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5" status: 404 len: 111 microversion: 2.1 time: 0.027612 Sep 02 17:10:58.081700 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 234/448] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:58 2021] GET /compute/v2.1/servers/5bb3c756-c618-430e-8157-87b5f85b7df5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 17:10:58.266510 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-58dc2205-e3bb-4f20-a865-0ff4804ee717 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:58.267179 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-58dc2205-e3bb-4f20-a865-0ff4804ee717 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:58.273692 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-58dc2205-e3bb-4f20-a865-0ff4804ee717 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:58.274138 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-58dc2205-e3bb-4f20-a865-0ff4804ee717 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:58.274924 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-58dc2205-e3bb-4f20-a865-0ff4804ee717 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:58.275364 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-58dc2205-e3bb-4f20-a865-0ff4804ee717 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:58.402174 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-58dc2205-e3bb-4f20-a865-0ff4804ee717 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:58.409382 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-58dc2205-e3bb-4f20-a865-0ff4804ee717 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1510 microversion: 2.1 time: 0.146533 Sep 02 17:10:58.409932 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 215/449] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:58 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:58.780663 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-b3a50b98-00b3-408b-9871-bf473eba5880 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:58.781557 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-b3a50b98-00b3-408b-9871-bf473eba5880 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:58.787416 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b3a50b98-00b3-408b-9871-bf473eba5880 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:58.788367 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b3a50b98-00b3-408b-9871-bf473eba5880 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:58.789113 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b3a50b98-00b3-408b-9871-bf473eba5880 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:58.789705 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b3a50b98-00b3-408b-9871-bf473eba5880 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:58.927734 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-b3a50b98-00b3-408b-9871-bf473eba5880 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38037 microversion: 2.1 time: 0.150454 Sep 02 17:10:58.929187 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 235/450] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:58 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38037 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:10:58.985212 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-e088a430-26ea-47b0-95eb-776c7ee24bdd tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:58.986455 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-e088a430-26ea-47b0-95eb-776c7ee24bdd tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:58.993143 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e088a430-26ea-47b0-95eb-776c7ee24bdd tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:58.993579 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e088a430-26ea-47b0-95eb-776c7ee24bdd tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:58.994337 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e088a430-26ea-47b0-95eb-776c7ee24bdd tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:58.994800 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e088a430-26ea-47b0-95eb-776c7ee24bdd tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:59.020303 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-0555dfa7-0374-4d2a-93ca-c6f17894ef51 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:59.021345 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-0555dfa7-0374-4d2a-93ca-c6f17894ef51 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 422ee9ba-ea68-49c1-8704-16f3da2e809c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:59.029349 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0555dfa7-0374-4d2a-93ca-c6f17894ef51 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:59.029788 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0555dfa7-0374-4d2a-93ca-c6f17894ef51 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:59.030555 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0555dfa7-0374-4d2a-93ca-c6f17894ef51 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:59.031021 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0555dfa7-0374-4d2a-93ca-c6f17894ef51 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:59.121842 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-e088a430-26ea-47b0-95eb-776c7ee24bdd tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 38040 microversion: 2.20 time: 0.140143 Sep 02 17:10:59.125163 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 216/451] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:10:58 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 38040 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:10:59.158275 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-0555dfa7-0374-4d2a-93ca-c6f17894ef51 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:59.165672 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-0555dfa7-0374-4d2a-93ca-c6f17894ef51 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c" status: 200 len: 1318 microversion: 2.1 time: 0.151590 Sep 02 17:10:59.166231 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 236/452] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:59 2021] GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:10:59.426840 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-fb7bc3c8-64b5-4b15-a726-3bb6dbe11265 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:10:59.427597 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-fb7bc3c8-64b5-4b15-a726-3bb6dbe11265 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:59.434916 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fb7bc3c8-64b5-4b15-a726-3bb6dbe11265 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:59.435362 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fb7bc3c8-64b5-4b15-a726-3bb6dbe11265 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:59.436167 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fb7bc3c8-64b5-4b15-a726-3bb6dbe11265 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:59.436600 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fb7bc3c8-64b5-4b15-a726-3bb6dbe11265 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:59.562442 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-fb7bc3c8-64b5-4b15-a726-3bb6dbe11265 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:10:59.570014 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-fb7bc3c8-64b5-4b15-a726-3bb6dbe11265 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1510 microversion: 2.1 time: 0.147943 Sep 02 17:10:59.570568 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 217/453] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:10:59 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1510 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:10:59.943770 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-fb823564-ce0b-457b-ab5d-9b6121162a92 req-977266c6-3978-42d0-8550-2a22e249b810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "422ee9ba-ea68-49c1-8704-16f3da2e809c", "name": "network-vif-plugged", "status": "completed", "tag": "b84c05c6-edce-4eb5-954d-fdf2e1e3e9a1"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:59.946241 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-2609c3d6-bb65-4953-80e7-9ef1c313c073 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:10:59.947190 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-2609c3d6-bb65-4953-80e7-9ef1c313c073 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:10:59.951910 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:10:59.951910 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:10:59.960742 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2609c3d6-bb65-4953-80e7-9ef1c313c073 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:59.961435 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2609c3d6-bb65-4953-80e7-9ef1c313c073 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:59.961771 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-fb823564-ce0b-457b-ab5d-9b6121162a92 req-977266c6-3978-42d0-8550-2a22e249b810 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:59.962217 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-fb823564-ce0b-457b-ab5d-9b6121162a92 req-977266c6-3978-42d0-8550-2a22e249b810 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:59.962785 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2609c3d6-bb65-4953-80e7-9ef1c313c073 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:10:59.963214 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2609c3d6-bb65-4953-80e7-9ef1c313c073 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:10:59.973492 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-fb823564-ce0b-457b-ab5d-9b6121162a92 req-977266c6-3978-42d0-8550-2a22e249b810 service nova] Creating event network-vif-plugged:b84c05c6-edce-4eb5-954d-fdf2e1e3e9a1 for instance 422ee9ba-ea68-49c1-8704-16f3da2e809c on hv-cinder-80626 Sep 02 17:10:59.979024 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-fb823564-ce0b-457b-ab5d-9b6121162a92 req-977266c6-3978-42d0-8550-2a22e249b810 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038715 Sep 02 17:10:59.979697 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 218/454] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:10:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:11:00.110488 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-2609c3d6-bb65-4953-80e7-9ef1c313c073 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38037 microversion: 2.1 time: 0.173359 Sep 02 17:11:00.114964 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 237/455] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:10:59 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38037 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:11:00.134323 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-5bb1e755-72bc-4535-9592-1bcaa093ccb9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:00.135334 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-5bb1e755-72bc-4535-9592-1bcaa093ccb9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:00.141391 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5bb1e755-72bc-4535-9592-1bcaa093ccb9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:00.141832 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5bb1e755-72bc-4535-9592-1bcaa093ccb9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:00.142658 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5bb1e755-72bc-4535-9592-1bcaa093ccb9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:00.143085 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5bb1e755-72bc-4535-9592-1bcaa093ccb9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:00.181751 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-2b883aa6-5c91-491b-bbe7-58ef6a243d9c tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:00.182448 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-2b883aa6-5c91-491b-bbe7-58ef6a243d9c tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 422ee9ba-ea68-49c1-8704-16f3da2e809c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:00.188958 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2b883aa6-5c91-491b-bbe7-58ef6a243d9c tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:00.189410 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2b883aa6-5c91-491b-bbe7-58ef6a243d9c tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:00.190179 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2b883aa6-5c91-491b-bbe7-58ef6a243d9c tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:00.190614 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2b883aa6-5c91-491b-bbe7-58ef6a243d9c tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:00.255425 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-5bb1e755-72bc-4535-9592-1bcaa093ccb9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 38040 microversion: 2.20 time: 0.125471 Sep 02 17:11:00.259967 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 219/456] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:11:00 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 38040 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:11:00.316208 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-2b883aa6-5c91-491b-bbe7-58ef6a243d9c tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:00.324913 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-2b883aa6-5c91-491b-bbe7-58ef6a243d9c tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c" status: 200 len: 1318 microversion: 2.1 time: 0.147256 Sep 02 17:11:00.325503 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 238/457] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:00 2021] GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:11:00.587258 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-51a89ccd-a127-46fb-8ada-805b78cc2be8 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:00.587962 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-51a89ccd-a127-46fb-8ada-805b78cc2be8 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:00.594554 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-51a89ccd-a127-46fb-8ada-805b78cc2be8 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:00.595118 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-51a89ccd-a127-46fb-8ada-805b78cc2be8 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:00.595944 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-51a89ccd-a127-46fb-8ada-805b78cc2be8 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:00.596378 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-51a89ccd-a127-46fb-8ada-805b78cc2be8 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:00.724673 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-51a89ccd-a127-46fb-8ada-805b78cc2be8 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:00.733781 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-51a89ccd-a127-46fb-8ada-805b78cc2be8 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1510 microversion: 2.1 time: 0.150289 Sep 02 17:11:00.734522 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 220/458] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:00 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:01.123072 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-c240ae6b-aace-4094-b59e-0e846eacc696 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:01.123984 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-c240ae6b-aace-4094-b59e-0e846eacc696 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:01.130570 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c240ae6b-aace-4094-b59e-0e846eacc696 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:01.131043 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c240ae6b-aace-4094-b59e-0e846eacc696 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:01.131823 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c240ae6b-aace-4094-b59e-0e846eacc696 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:01.132253 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c240ae6b-aace-4094-b59e-0e846eacc696 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:01.261925 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-c240ae6b-aace-4094-b59e-0e846eacc696 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38037 microversion: 2.1 time: 0.142314 Sep 02 17:11:01.269677 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 239/459] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:11:01 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38037 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:11:01.269897 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-531ea14a-bdcc-481d-a93a-ef25c9dcf63a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:01.269897 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-531ea14a-bdcc-481d-a93a-ef25c9dcf63a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:01.276746 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-531ea14a-bdcc-481d-a93a-ef25c9dcf63a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:01.277264 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-531ea14a-bdcc-481d-a93a-ef25c9dcf63a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:01.277936 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-531ea14a-bdcc-481d-a93a-ef25c9dcf63a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:01.278391 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-531ea14a-bdcc-481d-a93a-ef25c9dcf63a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:01.342056 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-ff57d832-caad-435a-be3b-bd1bfb98a711 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:01.342772 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-ff57d832-caad-435a-be3b-bd1bfb98a711 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 422ee9ba-ea68-49c1-8704-16f3da2e809c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:01.351447 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ff57d832-caad-435a-be3b-bd1bfb98a711 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:01.351889 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ff57d832-caad-435a-be3b-bd1bfb98a711 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:01.352648 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ff57d832-caad-435a-be3b-bd1bfb98a711 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:01.353073 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ff57d832-caad-435a-be3b-bd1bfb98a711 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:01.405907 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-531ea14a-bdcc-481d-a93a-ef25c9dcf63a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 38040 microversion: 2.20 time: 0.141504 Sep 02 17:11:01.406490 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 221/460] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:11:01 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 38040 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:11:01.474326 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-ff57d832-caad-435a-be3b-bd1bfb98a711 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:01.482907 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-ff57d832-caad-435a-be3b-bd1bfb98a711 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c" status: 200 len: 1318 microversion: 2.1 time: 0.144603 Sep 02 17:11:01.483545 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 240/461] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:01 2021] GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:11:01.753877 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-2188ee27-9e2b-4378-8e89-2429714ea2cb tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:01.754516 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-2188ee27-9e2b-4378-8e89-2429714ea2cb tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:01.761520 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2188ee27-9e2b-4378-8e89-2429714ea2cb tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:01.761969 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2188ee27-9e2b-4378-8e89-2429714ea2cb tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:01.762761 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2188ee27-9e2b-4378-8e89-2429714ea2cb tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:01.763204 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2188ee27-9e2b-4378-8e89-2429714ea2cb tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:01.892190 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-2188ee27-9e2b-4378-8e89-2429714ea2cb tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:01.900343 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-2188ee27-9e2b-4378-8e89-2429714ea2cb tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1516 microversion: 2.1 time: 0.150610 Sep 02 17:11:01.900987 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 222/462] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:01 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:02.279406 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-5c43f649-69b4-48ea-a764-068bcb8a3b2c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:02.280346 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-5c43f649-69b4-48ea-a764-068bcb8a3b2c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:02.286148 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5c43f649-69b4-48ea-a764-068bcb8a3b2c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:02.286529 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5c43f649-69b4-48ea-a764-068bcb8a3b2c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:02.287322 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5c43f649-69b4-48ea-a764-068bcb8a3b2c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:02.287787 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5c43f649-69b4-48ea-a764-068bcb8a3b2c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:02.418469 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-714ab83e-66a6-4a8b-ba3d-c34e4f18f67a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:02.419425 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-714ab83e-66a6-4a8b-ba3d-c34e4f18f67a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:02.425368 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-714ab83e-66a6-4a8b-ba3d-c34e4f18f67a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:02.425814 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-714ab83e-66a6-4a8b-ba3d-c34e4f18f67a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:02.426584 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-714ab83e-66a6-4a8b-ba3d-c34e4f18f67a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:02.427051 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-714ab83e-66a6-4a8b-ba3d-c34e4f18f67a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:02.478124 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-5c43f649-69b4-48ea-a764-068bcb8a3b2c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38037 microversion: 2.1 time: 0.202191 Sep 02 17:11:02.478790 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 241/463] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:11:02 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38037 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:11:02.500019 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-70f2f91f-9fac-4c3b-aa05-8197efd6120a tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:02.500707 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-70f2f91f-9fac-4c3b-aa05-8197efd6120a tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 422ee9ba-ea68-49c1-8704-16f3da2e809c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:02.507191 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-70f2f91f-9fac-4c3b-aa05-8197efd6120a tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:02.507631 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-70f2f91f-9fac-4c3b-aa05-8197efd6120a tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:02.508396 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-70f2f91f-9fac-4c3b-aa05-8197efd6120a tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:02.508823 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-70f2f91f-9fac-4c3b-aa05-8197efd6120a tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:02.555105 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-714ab83e-66a6-4a8b-ba3d-c34e4f18f67a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 38040 microversion: 2.20 time: 0.140110 Sep 02 17:11:02.555742 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 223/464] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:11:02 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 38040 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:11:02.637230 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-70f2f91f-9fac-4c3b-aa05-8197efd6120a tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:02.644629 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-70f2f91f-9fac-4c3b-aa05-8197efd6120a tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c" status: 200 len: 1508 microversion: 2.1 time: 0.148505 Sep 02 17:11:02.645210 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 242/465] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:02 2021] GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:11:03.253230 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-884c03ba-ba59-4f4a-b93e-37b05a743089 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:03.254454 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-884c03ba-ba59-4f4a-b93e-37b05a743089 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:03.264285 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-884c03ba-ba59-4f4a-b93e-37b05a743089 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:03.264733 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-884c03ba-ba59-4f4a-b93e-37b05a743089 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:03.265510 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-884c03ba-ba59-4f4a-b93e-37b05a743089 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:03.265942 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-884c03ba-ba59-4f4a-b93e-37b05a743089 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:03.394793 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-884c03ba-ba59-4f4a-b93e-37b05a743089 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:03.401985 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-884c03ba-ba59-4f4a-b93e-37b05a743089 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1516 microversion: 2.1 time: 0.152750 Sep 02 17:11:03.402533 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 224/466] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:03 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:03.418021 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-cc2f932b-4399-4126-89e9-432816ca08ce tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68e63001-5935-4387-b378-f71efbca4786"}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:03.419115 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-cc2f932b-4399-4126-89e9-432816ca08ce tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:03.424948 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-cc2f932b-4399-4126-89e9-432816ca08ce tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:03.425401 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-cc2f932b-4399-4126-89e9-432816ca08ce tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:03.426169 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-cc2f932b-4399-4126-89e9-432816ca08ce tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:03.426605 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-cc2f932b-4399-4126-89e9-432816ca08ce tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:03.489503 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-a67f7945-39cb-457a-9b7f-734ba097a92b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:03.490446 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-a67f7945-39cb-457a-9b7f-734ba097a92b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:03.496850 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a67f7945-39cb-457a-9b7f-734ba097a92b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:03.497301 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a67f7945-39cb-457a-9b7f-734ba097a92b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:03.498256 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a67f7945-39cb-457a-9b7f-734ba097a92b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:03.498581 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a67f7945-39cb-457a-9b7f-734ba097a92b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:03.658537 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-a67f7945-39cb-457a-9b7f-734ba097a92b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38044 microversion: 2.1 time: 0.172764 Sep 02 17:11:03.663702 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 225/467] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:11:03 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38044 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:11:03.665257 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-309a669d-8163-4957-b622-e37074b76c3f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:03.666249 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-309a669d-8163-4957-b622-e37074b76c3f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:03.673745 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-309a669d-8163-4957-b622-e37074b76c3f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:03.674201 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-309a669d-8163-4957-b622-e37074b76c3f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:03.675023 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-309a669d-8163-4957-b622-e37074b76c3f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:03.675459 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-309a669d-8163-4957-b622-e37074b76c3f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:03.735722 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-cc2f932b-4399-4126-89e9-432816ca08ce tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "POST /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321204 Sep 02 17:11:03.736618 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 243/468] 10.222.0.41 () {60 vars in 1323 bytes} [Thu Sep 2 17:11:03 2021] POST /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:11:03.874230 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-309a669d-8163-4957-b622-e37074b76c3f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 38077 microversion: 2.20 time: 0.213454 Sep 02 17:11:03.875975 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 226/469] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:11:03 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 38077 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:11:03.982451 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-deb400b1-af5c-4d40-b887-9386418822c3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ca90eeb-163f-41ef-9a42-f44a9163d318"}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:03.983730 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-deb400b1-af5c-4d40-b887-9386418822c3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 422ee9ba-ea68-49c1-8704-16f3da2e809c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:03.992114 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-deb400b1-af5c-4d40-b887-9386418822c3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:03.992837 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-deb400b1-af5c-4d40-b887-9386418822c3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:03.993333 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-deb400b1-af5c-4d40-b887-9386418822c3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:03.993771 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-deb400b1-af5c-4d40-b887-9386418822c3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:04.291666 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-deb400b1-af5c-4d40-b887-9386418822c3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "POST /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.313184 Sep 02 17:11:04.292263 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 244/470] 10.222.0.41 () {60 vars in 1323 bytes} [Thu Sep 2 17:11:03 2021] POST /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:11:04.672155 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-eaaf1689-7620-438d-aa0a-3d72f86728ef tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:04.673207 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-eaaf1689-7620-438d-aa0a-3d72f86728ef tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:04.680801 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-eaaf1689-7620-438d-aa0a-3d72f86728ef tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:04.681261 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-eaaf1689-7620-438d-aa0a-3d72f86728ef tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:04.682336 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-eaaf1689-7620-438d-aa0a-3d72f86728ef tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:04.682801 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-eaaf1689-7620-438d-aa0a-3d72f86728ef tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:04.805169 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-eaaf1689-7620-438d-aa0a-3d72f86728ef tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38165 microversion: 2.1 time: 0.136744 Sep 02 17:11:04.806141 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 227/471] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:11:04 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38165 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:11:04.887732 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-ef567060-3a08-444b-9465-4fcc1c621746 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:04.888797 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-ef567060-3a08-444b-9465-4fcc1c621746 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:04.899051 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ef567060-3a08-444b-9465-4fcc1c621746 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:04.899051 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ef567060-3a08-444b-9465-4fcc1c621746 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:04.899051 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ef567060-3a08-444b-9465-4fcc1c621746 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:04.899051 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ef567060-3a08-444b-9465-4fcc1c621746 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:05.024089 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-ef567060-3a08-444b-9465-4fcc1c621746 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 200 len: 38181 microversion: 2.20 time: 0.140393 Sep 02 17:11:05.025139 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 245/472] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:11:04 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 38181 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:11:05.036296 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-54ac695f-dc2c-47a8-bc14-a70a24329ef4 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:05.037106 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-54ac695f-dc2c-47a8-bc14-a70a24329ef4 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:05.052348 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-54ac695f-dc2c-47a8-bc14-a70a24329ef4 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:05.053041 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-54ac695f-dc2c-47a8-bc14-a70a24329ef4 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:05.056144 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-54ac695f-dc2c-47a8-bc14-a70a24329ef4 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:05.056144 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-54ac695f-dc2c-47a8-bc14-a70a24329ef4 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:05.088833 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-54ac695f-dc2c-47a8-bc14-a70a24329ef4 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/ips" status: 200 len: 152 microversion: 2.20 time: 0.056868 Sep 02 17:11:05.089403 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 228/473] 10.222.0.41 () {60 vars in 1289 bytes} [Thu Sep 2 17:11:05 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/ips => generated 152 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:11:05.816636 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-d07eec0c-61d5-4af8-867e-0f0c30faaf1e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:05.817628 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-d07eec0c-61d5-4af8-867e-0f0c30faaf1e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:05.824759 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d07eec0c-61d5-4af8-867e-0f0c30faaf1e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:05.825200 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d07eec0c-61d5-4af8-867e-0f0c30faaf1e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:05.825960 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d07eec0c-61d5-4af8-867e-0f0c30faaf1e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:05.826394 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d07eec0c-61d5-4af8-867e-0f0c30faaf1e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:08.549463 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-d07eec0c-61d5-4af8-867e-0f0c30faaf1e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38165 microversion: 2.1 time: 2.736682 Sep 02 17:11:08.554527 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 246/474] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:11:05 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38165 bytes in 2739 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:11:09.562069 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-fe5b9727-7cec-4fa9-9da2-24c6f620ce3c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:09.563004 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-fe5b9727-7cec-4fa9-9da2-24c6f620ce3c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:09.570047 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fe5b9727-7cec-4fa9-9da2-24c6f620ce3c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:09.570499 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fe5b9727-7cec-4fa9-9da2-24c6f620ce3c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:09.571302 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fe5b9727-7cec-4fa9-9da2-24c6f620ce3c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:09.571738 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fe5b9727-7cec-4fa9-9da2-24c6f620ce3c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:13.122707 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-fe5b9727-7cec-4fa9-9da2-24c6f620ce3c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38165 microversion: 2.1 time: 3.563993 Sep 02 17:11:13.123344 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 229/475] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:11:09 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38165 bytes in 3566 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:11:13.559443 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-5c633d10-e2a7-43c0-9e32-eb1f857c0df5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:13.560282 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-5c633d10-e2a7-43c0-9e32-eb1f857c0df5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:13.566863 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5c633d10-e2a7-43c0-9e32-eb1f857c0df5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:13.567299 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5c633d10-e2a7-43c0-9e32-eb1f857c0df5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:13.568063 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5c633d10-e2a7-43c0-9e32-eb1f857c0df5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:13.568563 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5c633d10-e2a7-43c0-9e32-eb1f857c0df5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:13.591593 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.objects.instance [None req-5c633d10-e2a7-43c0-9e32-eb1f857c0df5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lazy-loading 'flavor' on Instance uuid 4e92c68a-a864-4562-b08b-d244394268ce {{(pid=108417) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 17:11:14.055033 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-5c633d10-e2a7-43c0-9e32-eb1f857c0df5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 202 len: 0 microversion: 2.20 time: 0.499449 Sep 02 17:11:14.055807 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 247/476] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:11:13 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 02 17:11:14.065041 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-e1cded3d-8d71-49ca-98ed-8773c8238659 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:14.065837 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-e1cded3d-8d71-49ca-98ed-8773c8238659 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:14.072689 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e1cded3d-8d71-49ca-98ed-8773c8238659 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:14.073399 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e1cded3d-8d71-49ca-98ed-8773c8238659 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:14.074571 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e1cded3d-8d71-49ca-98ed-8773c8238659 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:14.075077 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e1cded3d-8d71-49ca-98ed-8773c8238659 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:14.135289 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-adc52a7b-6e80-4444-a6b5-55579ce0c3aa tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:14.136479 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-adc52a7b-6e80-4444-a6b5-55579ce0c3aa tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:14.143345 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-adc52a7b-6e80-4444-a6b5-55579ce0c3aa tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:14.143799 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-adc52a7b-6e80-4444-a6b5-55579ce0c3aa tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:14.144583 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-adc52a7b-6e80-4444-a6b5-55579ce0c3aa tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:14.145017 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-adc52a7b-6e80-4444-a6b5-55579ce0c3aa tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:14.214941 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-e1cded3d-8d71-49ca-98ed-8773c8238659 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:14.222540 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-e1cded3d-8d71-49ca-98ed-8773c8238659 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:14.224044 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-e1cded3d-8d71-49ca-98ed-8773c8238659 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:14.225792 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-e1cded3d-8d71-49ca-98ed-8773c8238659 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1722 microversion: 2.20 time: 0.165890 Sep 02 17:11:14.226334 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 230/477] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:11:14 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:11:14.270295 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-adc52a7b-6e80-4444-a6b5-55579ce0c3aa tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38165 microversion: 2.1 time: 0.139189 Sep 02 17:11:14.270971 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 248/478] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:11:14 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38165 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:11:15.245918 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-72f6adf5-8663-4369-9bef-cd0f40d456c3 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:15.246519 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-72f6adf5-8663-4369-9bef-cd0f40d456c3 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:15.256659 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-72f6adf5-8663-4369-9bef-cd0f40d456c3 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:15.257096 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-72f6adf5-8663-4369-9bef-cd0f40d456c3 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:15.257765 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-72f6adf5-8663-4369-9bef-cd0f40d456c3 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:15.258199 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-72f6adf5-8663-4369-9bef-cd0f40d456c3 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:15.283623 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-010ea851-98bf-422c-a76e-9b2175f34719 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:15.285094 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-010ea851-98bf-422c-a76e-9b2175f34719 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:15.292325 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-010ea851-98bf-422c-a76e-9b2175f34719 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:15.292972 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-010ea851-98bf-422c-a76e-9b2175f34719 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:15.294908 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-010ea851-98bf-422c-a76e-9b2175f34719 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:15.295462 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-010ea851-98bf-422c-a76e-9b2175f34719 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:15.432501 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-72f6adf5-8663-4369-9bef-cd0f40d456c3 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:15.442378 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-72f6adf5-8663-4369-9bef-cd0f40d456c3 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:15.444025 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-72f6adf5-8663-4369-9bef-cd0f40d456c3 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:15.445296 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-72f6adf5-8663-4369-9bef-cd0f40d456c3 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1722 microversion: 2.20 time: 0.203432 Sep 02 17:11:15.445834 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 231/479] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:11:15 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1722 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:11:15.613977 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-2afac166-bf12-46f0-acae-ca70828dcf97 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:15.614924 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-2afac166-bf12-46f0-acae-ca70828dcf97 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:15.621447 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2afac166-bf12-46f0-acae-ca70828dcf97 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:15.621893 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2afac166-bf12-46f0-acae-ca70828dcf97 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:15.622676 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2afac166-bf12-46f0-acae-ca70828dcf97 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:15.623107 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2afac166-bf12-46f0-acae-ca70828dcf97 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:15.646169 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.objects.instance [None req-2afac166-bf12-46f0-acae-ca70828dcf97 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lazy-loading 'flavor' on Instance uuid 089cf4bd-25a6-4572-a20b-99c71430e5f8 {{(pid=108418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 17:11:16.054494 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-2afac166-bf12-46f0-acae-ca70828dcf97 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "POST /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8/action" status: 200 len: 32 microversion: 2.1 time: 0.444443 Sep 02 17:11:16.055138 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 232/480] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:11:15 2021] POST /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8/action => generated 32 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 02 17:11:16.064847 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-a1cd5fd1-807c-4092-afbd-b1fa00397a95 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:16.065550 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-a1cd5fd1-807c-4092-afbd-b1fa00397a95 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:16.071563 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a1cd5fd1-807c-4092-afbd-b1fa00397a95 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:16.072008 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a1cd5fd1-807c-4092-afbd-b1fa00397a95 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:16.072770 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a1cd5fd1-807c-4092-afbd-b1fa00397a95 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:16.073207 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a1cd5fd1-807c-4092-afbd-b1fa00397a95 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:16.199353 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-a1cd5fd1-807c-4092-afbd-b1fa00397a95 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:16.207038 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-a1cd5fd1-807c-4092-afbd-b1fa00397a95 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1568 microversion: 2.1 time: 0.146687 Sep 02 17:11:16.207606 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 233/481] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:16 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:11:16.464262 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-51d0a060-8e05-45c7-aa80-d260fcc2d208 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:16.465117 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-51d0a060-8e05-45c7-aa80-d260fcc2d208 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:16.471201 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-51d0a060-8e05-45c7-aa80-d260fcc2d208 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:16.471650 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-51d0a060-8e05-45c7-aa80-d260fcc2d208 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:16.472422 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-51d0a060-8e05-45c7-aa80-d260fcc2d208 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:16.472858 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-51d0a060-8e05-45c7-aa80-d260fcc2d208 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:16.618049 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-51d0a060-8e05-45c7-aa80-d260fcc2d208 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:16.625686 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-51d0a060-8e05-45c7-aa80-d260fcc2d208 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:16.627207 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-51d0a060-8e05-45c7-aa80-d260fcc2d208 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:16.628349 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-51d0a060-8e05-45c7-aa80-d260fcc2d208 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1722 microversion: 2.20 time: 0.167852 Sep 02 17:11:16.628895 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 234/482] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:11:16 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:11:17.224039 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-d090ee90-8a96-4184-9a35-e9d0c529b529 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:17.224640 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-d090ee90-8a96-4184-9a35-e9d0c529b529 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:17.230661 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d090ee90-8a96-4184-9a35-e9d0c529b529 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:17.231371 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d090ee90-8a96-4184-9a35-e9d0c529b529 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:17.232183 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d090ee90-8a96-4184-9a35-e9d0c529b529 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:17.232617 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d090ee90-8a96-4184-9a35-e9d0c529b529 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:17.351983 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-d090ee90-8a96-4184-9a35-e9d0c529b529 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:17.360103 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-d090ee90-8a96-4184-9a35-e9d0c529b529 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1568 microversion: 2.1 time: 0.139624 Sep 02 17:11:17.360647 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 235/483] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:17 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:11:17.646093 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-40e5fe53-3779-40d2-bd9e-3069620fe086 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:17.646738 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-40e5fe53-3779-40d2-bd9e-3069620fe086 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:17.652675 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-40e5fe53-3779-40d2-bd9e-3069620fe086 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:17.653118 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-40e5fe53-3779-40d2-bd9e-3069620fe086 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:17.653869 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-40e5fe53-3779-40d2-bd9e-3069620fe086 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:17.654292 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-40e5fe53-3779-40d2-bd9e-3069620fe086 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:17.774470 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-40e5fe53-3779-40d2-bd9e-3069620fe086 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:17.782780 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-40e5fe53-3779-40d2-bd9e-3069620fe086 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:17.784175 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-40e5fe53-3779-40d2-bd9e-3069620fe086 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:17.785361 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-40e5fe53-3779-40d2-bd9e-3069620fe086 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1722 microversion: 2.20 time: 0.142951 Sep 02 17:11:17.785914 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 236/484] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:11:17 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1722 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:11:18.221725 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-010ea851-98bf-422c-a76e-9b2175f34719 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38165 microversion: 2.1 time: 2.942087 Sep 02 17:11:18.222359 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 249/485] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:11:15 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38165 bytes in 2944 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:11:18.379252 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-efdba691-0697-4339-a2b7-a838eb954c4c tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:18.379861 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-efdba691-0697-4339-a2b7-a838eb954c4c tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:18.386257 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-efdba691-0697-4339-a2b7-a838eb954c4c tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:18.386726 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-efdba691-0697-4339-a2b7-a838eb954c4c tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:18.387482 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-efdba691-0697-4339-a2b7-a838eb954c4c tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:18.387907 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-efdba691-0697-4339-a2b7-a838eb954c4c tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:18.584473 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-efdba691-0697-4339-a2b7-a838eb954c4c tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:18.592575 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-efdba691-0697-4339-a2b7-a838eb954c4c tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1568 microversion: 2.1 time: 0.216861 Sep 02 17:11:18.593155 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 237/486] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:18 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1568 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:18.804716 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-9974b48e-537b-4f31-a112-b593c48d677e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:18.805397 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-9974b48e-537b-4f31-a112-b593c48d677e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:18.812281 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9974b48e-537b-4f31-a112-b593c48d677e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:18.812723 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9974b48e-537b-4f31-a112-b593c48d677e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:18.813485 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9974b48e-537b-4f31-a112-b593c48d677e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:18.813928 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9974b48e-537b-4f31-a112-b593c48d677e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:18.961499 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-9974b48e-537b-4f31-a112-b593c48d677e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:18.969397 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-9974b48e-537b-4f31-a112-b593c48d677e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:18.970917 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-9974b48e-537b-4f31-a112-b593c48d677e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:18.972108 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-9974b48e-537b-4f31-a112-b593c48d677e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1722 microversion: 2.20 time: 0.171917 Sep 02 17:11:18.972593 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 250/487] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:11:18 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:11:19.239542 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-6f73007d-1297-4e74-b735-a5223cbd3497 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:19.241189 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-6f73007d-1297-4e74-b735-a5223cbd3497 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:19.247234 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6f73007d-1297-4e74-b735-a5223cbd3497 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:19.247687 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6f73007d-1297-4e74-b735-a5223cbd3497 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:19.248453 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6f73007d-1297-4e74-b735-a5223cbd3497 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:19.248883 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6f73007d-1297-4e74-b735-a5223cbd3497 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:19.369021 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-6f73007d-1297-4e74-b735-a5223cbd3497 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38165 microversion: 2.1 time: 0.133329 Sep 02 17:11:19.369688 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 238/488] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:11:19 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38165 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:11:19.609387 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-963b01b5-dc7b-4e88-98d6-db7050260a92 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:19.609997 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-963b01b5-dc7b-4e88-98d6-db7050260a92 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:19.616440 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-963b01b5-dc7b-4e88-98d6-db7050260a92 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:19.616874 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-963b01b5-dc7b-4e88-98d6-db7050260a92 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:19.617640 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-963b01b5-dc7b-4e88-98d6-db7050260a92 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:19.618063 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-963b01b5-dc7b-4e88-98d6-db7050260a92 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:19.740937 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-963b01b5-dc7b-4e88-98d6-db7050260a92 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:19.748609 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-963b01b5-dc7b-4e88-98d6-db7050260a92 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1568 microversion: 2.1 time: 0.143103 Sep 02 17:11:19.749165 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 251/489] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:19 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1568 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:19.991174 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-e045cedb-faed-4da7-a624-426c2c045af5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:19.991888 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-e045cedb-faed-4da7-a624-426c2c045af5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:19.998334 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e045cedb-faed-4da7-a624-426c2c045af5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:19.998816 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e045cedb-faed-4da7-a624-426c2c045af5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:19.999572 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e045cedb-faed-4da7-a624-426c2c045af5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:20.000000 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e045cedb-faed-4da7-a624-426c2c045af5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:20.346654 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-e045cedb-faed-4da7-a624-426c2c045af5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:20.354802 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-e045cedb-faed-4da7-a624-426c2c045af5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:20.356384 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-e045cedb-faed-4da7-a624-426c2c045af5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:20.357834 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-e045cedb-faed-4da7-a624-426c2c045af5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1722 microversion: 2.20 time: 0.370430 Sep 02 17:11:20.358435 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 239/490] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:11:19 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1722 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:11:20.381026 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-73984c0d-7f7f-4df5-91d3-c477818bdc49 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:20.382508 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-73984c0d-7f7f-4df5-91d3-c477818bdc49 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:20.388833 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-73984c0d-7f7f-4df5-91d3-c477818bdc49 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:20.389282 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-73984c0d-7f7f-4df5-91d3-c477818bdc49 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:20.390110 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-73984c0d-7f7f-4df5-91d3-c477818bdc49 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:20.390555 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-73984c0d-7f7f-4df5-91d3-c477818bdc49 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:20.506340 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-73984c0d-7f7f-4df5-91d3-c477818bdc49 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38165 microversion: 2.1 time: 0.129086 Sep 02 17:11:20.507225 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 252/491] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:11:20 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38165 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:11:20.764998 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-3598e614-0e16-454c-b87d-3a71019c157f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:20.765601 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-3598e614-0e16-454c-b87d-3a71019c157f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:20.771418 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3598e614-0e16-454c-b87d-3a71019c157f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:20.772540 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3598e614-0e16-454c-b87d-3a71019c157f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:20.773365 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3598e614-0e16-454c-b87d-3a71019c157f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:20.773794 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3598e614-0e16-454c-b87d-3a71019c157f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:20.911176 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-3598e614-0e16-454c-b87d-3a71019c157f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:20.920069 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-3598e614-0e16-454c-b87d-3a71019c157f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1568 microversion: 2.1 time: 0.158641 Sep 02 17:11:20.920808 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 240/492] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:20 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:21.377552 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-6ac9a78d-7761-41a7-b8c4-47438ff2367a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:21.378246 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-6ac9a78d-7761-41a7-b8c4-47438ff2367a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:21.385216 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6ac9a78d-7761-41a7-b8c4-47438ff2367a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:21.385654 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6ac9a78d-7761-41a7-b8c4-47438ff2367a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:21.386412 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6ac9a78d-7761-41a7-b8c4-47438ff2367a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:21.386868 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6ac9a78d-7761-41a7-b8c4-47438ff2367a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:21.519833 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-e315c8ee-76fd-4076-b72f-9c71fc95c8f2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:21.520802 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-e315c8ee-76fd-4076-b72f-9c71fc95c8f2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:21.522805 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-6ac9a78d-7761-41a7-b8c4-47438ff2367a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:21.528451 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e315c8ee-76fd-4076-b72f-9c71fc95c8f2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:21.528987 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e315c8ee-76fd-4076-b72f-9c71fc95c8f2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:21.529763 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e315c8ee-76fd-4076-b72f-9c71fc95c8f2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:21.530189 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e315c8ee-76fd-4076-b72f-9c71fc95c8f2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:21.541045 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-6ac9a78d-7761-41a7-b8c4-47438ff2367a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:21.541045 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-6ac9a78d-7761-41a7-b8c4-47438ff2367a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:21.541045 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-6ac9a78d-7761-41a7-b8c4-47438ff2367a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1722 microversion: 2.20 time: 0.165657 Sep 02 17:11:21.541428 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 253/493] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:11:21 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:11:21.661627 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-e315c8ee-76fd-4076-b72f-9c71fc95c8f2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38165 microversion: 2.1 time: 0.145516 Sep 02 17:11:21.665993 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 241/494] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:11:21 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38165 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:11:21.936679 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-87aad302-dd0f-4fe7-afaf-d12885657fef tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:21.937278 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-87aad302-dd0f-4fe7-afaf-d12885657fef tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:21.943200 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-87aad302-dd0f-4fe7-afaf-d12885657fef tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:21.943647 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-87aad302-dd0f-4fe7-afaf-d12885657fef tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:21.944440 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-87aad302-dd0f-4fe7-afaf-d12885657fef tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:21.944865 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-87aad302-dd0f-4fe7-afaf-d12885657fef tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:22.105154 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-87aad302-dd0f-4fe7-afaf-d12885657fef tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:22.113882 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-87aad302-dd0f-4fe7-afaf-d12885657fef tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1568 microversion: 2.1 time: 0.180687 Sep 02 17:11:22.114551 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 254/495] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:21 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:22.558464 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-e9bd1095-1a2e-43d0-a3c1-61ed3e8f86b5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:22.559184 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-e9bd1095-1a2e-43d0-a3c1-61ed3e8f86b5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:22.565692 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e9bd1095-1a2e-43d0-a3c1-61ed3e8f86b5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:22.566139 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e9bd1095-1a2e-43d0-a3c1-61ed3e8f86b5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:22.566937 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e9bd1095-1a2e-43d0-a3c1-61ed3e8f86b5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:22.567371 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e9bd1095-1a2e-43d0-a3c1-61ed3e8f86b5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:22.674381 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-c8af0779-4b30-4444-98e2-f3231dbd9b64 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:22.676010 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-c8af0779-4b30-4444-98e2-f3231dbd9b64 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:22.682541 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c8af0779-4b30-4444-98e2-f3231dbd9b64 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:22.683090 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c8af0779-4b30-4444-98e2-f3231dbd9b64 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:22.683932 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c8af0779-4b30-4444-98e2-f3231dbd9b64 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:22.684607 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c8af0779-4b30-4444-98e2-f3231dbd9b64 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:22.699747 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-e9bd1095-1a2e-43d0-a3c1-61ed3e8f86b5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:22.708454 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-e9bd1095-1a2e-43d0-a3c1-61ed3e8f86b5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:22.711624 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-e9bd1095-1a2e-43d0-a3c1-61ed3e8f86b5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:22.713267 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-e9bd1095-1a2e-43d0-a3c1-61ed3e8f86b5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1722 microversion: 2.20 time: 0.158909 Sep 02 17:11:22.714833 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 242/496] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:11:22 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:11:22.811177 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-c8af0779-4b30-4444-98e2-f3231dbd9b64 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38165 microversion: 2.1 time: 0.140813 Sep 02 17:11:22.812728 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 255/497] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:11:22 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38165 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:11:23.140015 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-697b8268-1fc2-47ed-9228-769426b0be45 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:23.141210 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-671127be-bfa9-4436-af50-5a71d0ca3d0e tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:23.143850 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-671127be-bfa9-4436-af50-5a71d0ca3d0e tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 90cb7d6a-93e4-427e-bdba-de422d89fa0f] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:23.144043 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-697b8268-1fc2-47ed-9228-769426b0be45 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:23.155764 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-671127be-bfa9-4436-af50-5a71d0ca3d0e tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:23.158093 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-697b8268-1fc2-47ed-9228-769426b0be45 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:23.159016 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-671127be-bfa9-4436-af50-5a71d0ca3d0e tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:23.159955 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-671127be-bfa9-4436-af50-5a71d0ca3d0e tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:23.160552 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-697b8268-1fc2-47ed-9228-769426b0be45 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:23.161712 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-671127be-bfa9-4436-af50-5a71d0ca3d0e tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:23.162130 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-697b8268-1fc2-47ed-9228-769426b0be45 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:23.162561 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-697b8268-1fc2-47ed-9228-769426b0be45 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:23.288662 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.objects.instance [None req-671127be-bfa9-4436-af50-5a71d0ca3d0e tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lazy-loading 'services' on Instance uuid 90cb7d6a-93e4-427e-bdba-de422d89fa0f {{(pid=108418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 17:11:23.352967 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-697b8268-1fc2-47ed-9228-769426b0be45 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:23.360867 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-697b8268-1fc2-47ed-9228-769426b0be45 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1568 microversion: 2.1 time: 0.225256 Sep 02 17:11:23.361701 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 256/498] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:23 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1568 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:11:23.399416 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-671127be-bfa9-4436-af50-5a71d0ca3d0e tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "DELETE /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f/os-volume_attachments/096e3897-06d4-4339-9ff5-bd167f49e30b" status: 202 len: 0 microversion: 2.1 time: 0.268999 Sep 02 17:11:23.403387 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 243/499] 10.222.0.41 () {58 vars in 1416 bytes} [Thu Sep 2 17:11:23 2021] DELETE /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f/os-volume_attachments/096e3897-06d4-4339-9ff5-bd167f49e30b => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:11:23.731793 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-6f417d60-af79-4c2a-ad16-acb2b12b3e25 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:23.732425 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-6f417d60-af79-4c2a-ad16-acb2b12b3e25 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:23.750404 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6f417d60-af79-4c2a-ad16-acb2b12b3e25 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:23.751301 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6f417d60-af79-4c2a-ad16-acb2b12b3e25 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:23.752740 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6f417d60-af79-4c2a-ad16-acb2b12b3e25 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:23.753683 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6f417d60-af79-4c2a-ad16-acb2b12b3e25 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:23.825402 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-4a8853b9-e27e-4292-90c7-d7a99cf2c9d2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:23.826474 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-4a8853b9-e27e-4292-90c7-d7a99cf2c9d2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:23.832960 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4a8853b9-e27e-4292-90c7-d7a99cf2c9d2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:23.833420 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4a8853b9-e27e-4292-90c7-d7a99cf2c9d2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:23.834970 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4a8853b9-e27e-4292-90c7-d7a99cf2c9d2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:23.835408 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4a8853b9-e27e-4292-90c7-d7a99cf2c9d2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:23.924670 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-6f417d60-af79-4c2a-ad16-acb2b12b3e25 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:23.932570 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-6f417d60-af79-4c2a-ad16-acb2b12b3e25 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:23.934073 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-6f417d60-af79-4c2a-ad16-acb2b12b3e25 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:23.935276 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-6f417d60-af79-4c2a-ad16-acb2b12b3e25 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1722 microversion: 2.20 time: 0.207205 Sep 02 17:11:23.935840 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 257/500] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:11:23 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:11:23.975622 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-4a8853b9-e27e-4292-90c7-d7a99cf2c9d2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38165 microversion: 2.1 time: 0.154808 Sep 02 17:11:23.977006 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 244/501] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:11:23 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38165 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:11:24.378589 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-b809c6c8-97b3-499c-aeef-379635a27a07 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:24.379232 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-b809c6c8-97b3-499c-aeef-379635a27a07 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:24.386228 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b809c6c8-97b3-499c-aeef-379635a27a07 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:24.386980 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b809c6c8-97b3-499c-aeef-379635a27a07 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:24.387766 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b809c6c8-97b3-499c-aeef-379635a27a07 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:24.388196 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b809c6c8-97b3-499c-aeef-379635a27a07 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:24.539700 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-b809c6c8-97b3-499c-aeef-379635a27a07 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:24.553565 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-b809c6c8-97b3-499c-aeef-379635a27a07 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1568 microversion: 2.1 time: 0.178115 Sep 02 17:11:24.563855 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 258/502] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:24 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1568 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:24.961137 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-d60447b5-4c67-4082-a02a-cc7952b999a6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:24.963174 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-d60447b5-4c67-4082-a02a-cc7952b999a6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:24.970500 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d60447b5-4c67-4082-a02a-cc7952b999a6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:24.971173 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d60447b5-4c67-4082-a02a-cc7952b999a6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:24.972197 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d60447b5-4c67-4082-a02a-cc7952b999a6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:24.973274 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d60447b5-4c67-4082-a02a-cc7952b999a6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:24.987192 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-04dd91d5-3020-417b-a821-66f27706d974 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:24.988106 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-04dd91d5-3020-417b-a821-66f27706d974 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:25.001009 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-04dd91d5-3020-417b-a821-66f27706d974 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:25.001571 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-04dd91d5-3020-417b-a821-66f27706d974 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:25.003317 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-04dd91d5-3020-417b-a821-66f27706d974 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:25.005280 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-04dd91d5-3020-417b-a821-66f27706d974 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:25.141297 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-04dd91d5-3020-417b-a821-66f27706d974 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38165 microversion: 2.1 time: 0.158117 Sep 02 17:11:25.141970 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 259/503] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:11:24 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38165 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:11:25.278992 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-d60447b5-4c67-4082-a02a-cc7952b999a6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:25.295123 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-d60447b5-4c67-4082-a02a-cc7952b999a6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:25.298418 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-d60447b5-4c67-4082-a02a-cc7952b999a6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:25.299641 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-d60447b5-4c67-4082-a02a-cc7952b999a6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1722 microversion: 2.20 time: 0.348977 Sep 02 17:11:25.300377 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 245/504] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:11:24 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1722 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:11:25.571236 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-e6ed6e89-b5ac-47c7-970b-ec935c3e93ff tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:25.572217 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-e6ed6e89-b5ac-47c7-970b-ec935c3e93ff tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:25.589929 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e6ed6e89-b5ac-47c7-970b-ec935c3e93ff tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:25.592810 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e6ed6e89-b5ac-47c7-970b-ec935c3e93ff tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:25.598241 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e6ed6e89-b5ac-47c7-970b-ec935c3e93ff tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:25.598956 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e6ed6e89-b5ac-47c7-970b-ec935c3e93ff tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:25.827627 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-e6ed6e89-b5ac-47c7-970b-ec935c3e93ff tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:25.835619 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-e6ed6e89-b5ac-47c7-970b-ec935c3e93ff tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1568 microversion: 2.1 time: 0.268606 Sep 02 17:11:25.836575 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 260/505] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:25 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1568 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:26.153545 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-7b07cbe9-7bf4-4812-8b69-ae1be3ae9d93 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:26.155104 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-7b07cbe9-7bf4-4812-8b69-ae1be3ae9d93 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:26.161391 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7b07cbe9-7bf4-4812-8b69-ae1be3ae9d93 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:26.162138 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7b07cbe9-7bf4-4812-8b69-ae1be3ae9d93 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:26.163442 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7b07cbe9-7bf4-4812-8b69-ae1be3ae9d93 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:26.164026 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7b07cbe9-7bf4-4812-8b69-ae1be3ae9d93 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:26.301181 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-7b07cbe9-7bf4-4812-8b69-ae1be3ae9d93 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38165 microversion: 2.1 time: 0.151036 Sep 02 17:11:26.302134 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 246/506] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:11:26 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38165 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:11:26.358657 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-5d459a07-1e08-4646-8507-804bd86452d5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:26.359486 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-5d459a07-1e08-4646-8507-804bd86452d5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:26.365916 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5d459a07-1e08-4646-8507-804bd86452d5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:26.366371 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5d459a07-1e08-4646-8507-804bd86452d5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:26.367186 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5d459a07-1e08-4646-8507-804bd86452d5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:26.367625 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5d459a07-1e08-4646-8507-804bd86452d5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:26.549221 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-5d459a07-1e08-4646-8507-804bd86452d5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:26.560192 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-5d459a07-1e08-4646-8507-804bd86452d5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:26.573345 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-5d459a07-1e08-4646-8507-804bd86452d5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:26.575053 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-5d459a07-1e08-4646-8507-804bd86452d5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1722 microversion: 2.20 time: 0.261139 Sep 02 17:11:26.575671 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 261/507] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:11:26 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:11:26.861011 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-638ebc66-f7a6-42ce-9169-c09e8a80bd76 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:26.862419 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-638ebc66-f7a6-42ce-9169-c09e8a80bd76 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:26.871687 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-638ebc66-f7a6-42ce-9169-c09e8a80bd76 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:26.872466 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-638ebc66-f7a6-42ce-9169-c09e8a80bd76 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:26.873835 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-638ebc66-f7a6-42ce-9169-c09e8a80bd76 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:26.875161 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-638ebc66-f7a6-42ce-9169-c09e8a80bd76 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:27.062966 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-638ebc66-f7a6-42ce-9169-c09e8a80bd76 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:27.073713 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-638ebc66-f7a6-42ce-9169-c09e8a80bd76 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1568 microversion: 2.1 time: 0.223591 Sep 02 17:11:27.086500 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 247/508] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:26 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1568 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:27.314168 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-9605a051-8bd2-4a38-a02b-70c0058542c7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:27.315105 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-9605a051-8bd2-4a38-a02b-70c0058542c7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:27.321790 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9605a051-8bd2-4a38-a02b-70c0058542c7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:27.322229 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9605a051-8bd2-4a38-a02b-70c0058542c7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:27.323378 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9605a051-8bd2-4a38-a02b-70c0058542c7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:27.323994 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9605a051-8bd2-4a38-a02b-70c0058542c7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:27.594439 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-e10f2e5a-1612-49e1-8b66-c9cccf4669e8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:27.595085 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-e10f2e5a-1612-49e1-8b66-c9cccf4669e8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:27.601993 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e10f2e5a-1612-49e1-8b66-c9cccf4669e8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:27.602434 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e10f2e5a-1612-49e1-8b66-c9cccf4669e8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:27.603251 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e10f2e5a-1612-49e1-8b66-c9cccf4669e8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:27.603684 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e10f2e5a-1612-49e1-8b66-c9cccf4669e8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:27.809830 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-e10f2e5a-1612-49e1-8b66-c9cccf4669e8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:27.821608 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-e10f2e5a-1612-49e1-8b66-c9cccf4669e8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:27.823229 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-e10f2e5a-1612-49e1-8b66-c9cccf4669e8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:27.824425 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-e10f2e5a-1612-49e1-8b66-c9cccf4669e8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1722 microversion: 2.20 time: 0.234280 Sep 02 17:11:27.825300 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 248/509] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:11:27 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:11:28.093185 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-1e6c491b-40de-45bb-98f1-e5f3e396d1fe tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:28.093862 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-1e6c491b-40de-45bb-98f1-e5f3e396d1fe tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:28.100286 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1e6c491b-40de-45bb-98f1-e5f3e396d1fe tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:28.100801 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1e6c491b-40de-45bb-98f1-e5f3e396d1fe tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:28.101792 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1e6c491b-40de-45bb-98f1-e5f3e396d1fe tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:28.102417 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1e6c491b-40de-45bb-98f1-e5f3e396d1fe tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:28.253943 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-1e6c491b-40de-45bb-98f1-e5f3e396d1fe tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:28.262482 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-1e6c491b-40de-45bb-98f1-e5f3e396d1fe tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1568 microversion: 2.1 time: 0.172939 Sep 02 17:11:28.263100 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 249/510] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:28 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:11:28.846378 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-b9efb3a0-0460-4917-bdbf-c55fd5794240 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:28.847563 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-b9efb3a0-0460-4917-bdbf-c55fd5794240 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:28.856860 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b9efb3a0-0460-4917-bdbf-c55fd5794240 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:28.857929 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b9efb3a0-0460-4917-bdbf-c55fd5794240 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:28.859003 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b9efb3a0-0460-4917-bdbf-c55fd5794240 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:28.860355 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b9efb3a0-0460-4917-bdbf-c55fd5794240 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:29.060474 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-b9efb3a0-0460-4917-bdbf-c55fd5794240 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:29.068772 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-b9efb3a0-0460-4917-bdbf-c55fd5794240 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:29.071090 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-b9efb3a0-0460-4917-bdbf-c55fd5794240 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:29.072442 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-b9efb3a0-0460-4917-bdbf-c55fd5794240 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1722 microversion: 2.20 time: 0.233081 Sep 02 17:11:29.072961 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 250/511] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:11:28 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:11:29.294558 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-a7490017-9357-434b-b979-c12e85613713 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:29.295777 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-a7490017-9357-434b-b979-c12e85613713 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:29.305218 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a7490017-9357-434b-b979-c12e85613713 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:29.305685 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a7490017-9357-434b-b979-c12e85613713 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:29.310866 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a7490017-9357-434b-b979-c12e85613713 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:29.311395 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a7490017-9357-434b-b979-c12e85613713 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:29.335856 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-9605a051-8bd2-4a38-a02b-70c0058542c7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38165 microversion: 2.1 time: 2.025458 Sep 02 17:11:29.339931 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 262/512] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:11:27 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38165 bytes in 2027 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:11:29.504453 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-a7490017-9357-434b-b979-c12e85613713 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:29.517032 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-a7490017-9357-434b-b979-c12e85613713 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1568 microversion: 2.1 time: 0.241383 Sep 02 17:11:29.527731 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 251/513] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:29 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1568 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:30.098829 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-6c062ef2-3217-4e0e-acab-d1d3063834ee tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:30.099814 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-6c062ef2-3217-4e0e-acab-d1d3063834ee tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:30.108971 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6c062ef2-3217-4e0e-acab-d1d3063834ee tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:30.109648 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6c062ef2-3217-4e0e-acab-d1d3063834ee tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:30.110438 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6c062ef2-3217-4e0e-acab-d1d3063834ee tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:30.110920 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6c062ef2-3217-4e0e-acab-d1d3063834ee tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:30.348227 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-148881e8-18d0-438b-8e59-ac5ca1b0fffd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:30.350956 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-148881e8-18d0-438b-8e59-ac5ca1b0fffd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:30.362251 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-6c062ef2-3217-4e0e-acab-d1d3063834ee tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:30.371564 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-148881e8-18d0-438b-8e59-ac5ca1b0fffd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:30.372252 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-148881e8-18d0-438b-8e59-ac5ca1b0fffd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:30.373478 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-148881e8-18d0-438b-8e59-ac5ca1b0fffd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:30.374062 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-148881e8-18d0-438b-8e59-ac5ca1b0fffd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:30.377815 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-6c062ef2-3217-4e0e-acab-d1d3063834ee tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:30.380771 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-6c062ef2-3217-4e0e-acab-d1d3063834ee tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:30.383929 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-6c062ef2-3217-4e0e-acab-d1d3063834ee tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1722 microversion: 2.20 time: 0.289200 Sep 02 17:11:30.384589 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 263/514] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:11:30 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1722 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:11:30.498016 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-30f0e7eb-ee21-45c3-be0a-384d1a6151ff tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:30.498695 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-30f0e7eb-ee21-45c3-be0a-384d1a6151ff tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 422ee9ba-ea68-49c1-8704-16f3da2e809c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:30.506219 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-30f0e7eb-ee21-45c3-be0a-384d1a6151ff tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:30.508354 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-30f0e7eb-ee21-45c3-be0a-384d1a6151ff tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:30.509379 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-30f0e7eb-ee21-45c3-be0a-384d1a6151ff tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:30.510040 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-30f0e7eb-ee21-45c3-be0a-384d1a6151ff tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:30.545833 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-148881e8-18d0-438b-8e59-ac5ca1b0fffd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38165 microversion: 2.1 time: 0.201817 Sep 02 17:11:30.546990 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 252/515] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:11:30 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38165 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:11:30.565368 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-a76cb6ad-50f6-4240-8eec-14279c4f56aa tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:30.566483 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-a76cb6ad-50f6-4240-8eec-14279c4f56aa tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:30.587521 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a76cb6ad-50f6-4240-8eec-14279c4f56aa tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:30.588028 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a76cb6ad-50f6-4240-8eec-14279c4f56aa tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:30.588858 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a76cb6ad-50f6-4240-8eec-14279c4f56aa tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:30.589288 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a76cb6ad-50f6-4240-8eec-14279c4f56aa tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:30.659864 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.objects.instance [None req-30f0e7eb-ee21-45c3-be0a-384d1a6151ff tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lazy-loading 'services' on Instance uuid 422ee9ba-ea68-49c1-8704-16f3da2e809c {{(pid=108417) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 17:11:30.821901 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-30f0e7eb-ee21-45c3-be0a-384d1a6151ff tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "DELETE /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c/os-volume_attachments/4ca90eeb-163f-41ef-9a42-f44a9163d318" status: 202 len: 0 microversion: 2.1 time: 0.326647 Sep 02 17:11:30.823216 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 264/516] 10.222.0.41 () {58 vars in 1416 bytes} [Thu Sep 2 17:11:30 2021] DELETE /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c/os-volume_attachments/4ca90eeb-163f-41ef-9a42-f44a9163d318 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:11:30.832734 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-05cc5349-04e7-4a93-b4eb-ad309c63f11e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:30.835101 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-05cc5349-04e7-4a93-b4eb-ad309c63f11e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 422ee9ba-ea68-49c1-8704-16f3da2e809c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:30.845171 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-05cc5349-04e7-4a93-b4eb-ad309c63f11e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:30.845986 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-05cc5349-04e7-4a93-b4eb-ad309c63f11e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:30.848190 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-05cc5349-04e7-4a93-b4eb-ad309c63f11e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:30.848785 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-05cc5349-04e7-4a93-b4eb-ad309c63f11e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:30.935420 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-05cc5349-04e7-4a93-b4eb-ad309c63f11e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.105515 Sep 02 17:11:30.937825 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 265/517] 10.222.0.41 () {58 vars in 1302 bytes} [Thu Sep 2 17:11:30 2021] GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:11:30.992535 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-a76cb6ad-50f6-4240-8eec-14279c4f56aa tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:31.002380 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-a76cb6ad-50f6-4240-8eec-14279c4f56aa tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1568 microversion: 2.1 time: 0.454098 Sep 02 17:11:31.007602 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 253/518] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:30 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1568 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:31.402546 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-471ef0b9-026f-4820-93ca-f7e6fc1de8e0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:31.403251 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-471ef0b9-026f-4820-93ca-f7e6fc1de8e0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:31.424926 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-471ef0b9-026f-4820-93ca-f7e6fc1de8e0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:31.425366 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-471ef0b9-026f-4820-93ca-f7e6fc1de8e0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:31.426274 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-471ef0b9-026f-4820-93ca-f7e6fc1de8e0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:31.426951 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-471ef0b9-026f-4820-93ca-f7e6fc1de8e0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:31.559719 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-1404dec5-1cd4-4442-bcbb-50f059e5fa89 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:31.561745 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-1404dec5-1cd4-4442-bcbb-50f059e5fa89 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:31.574642 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1404dec5-1cd4-4442-bcbb-50f059e5fa89 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:31.575378 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1404dec5-1cd4-4442-bcbb-50f059e5fa89 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:31.576832 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1404dec5-1cd4-4442-bcbb-50f059e5fa89 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:31.580002 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1404dec5-1cd4-4442-bcbb-50f059e5fa89 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:31.643196 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-471ef0b9-026f-4820-93ca-f7e6fc1de8e0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:31.653579 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-471ef0b9-026f-4820-93ca-f7e6fc1de8e0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:31.655662 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-471ef0b9-026f-4820-93ca-f7e6fc1de8e0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:31.657052 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-471ef0b9-026f-4820-93ca-f7e6fc1de8e0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1722 microversion: 2.20 time: 0.258590 Sep 02 17:11:31.658246 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 266/519] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:11:31 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1722 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:11:31.738728 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-1404dec5-1cd4-4442-bcbb-50f059e5fa89 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38165 microversion: 2.1 time: 0.184446 Sep 02 17:11:31.739699 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 254/520] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:11:31 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38165 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:11:31.947233 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-d571078e-4838-40f9-8845-e2ac759bb6ad tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:31.948153 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-d571078e-4838-40f9-8845-e2ac759bb6ad tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 422ee9ba-ea68-49c1-8704-16f3da2e809c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:31.962424 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d571078e-4838-40f9-8845-e2ac759bb6ad tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:31.962897 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d571078e-4838-40f9-8845-e2ac759bb6ad tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:31.963869 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d571078e-4838-40f9-8845-e2ac759bb6ad tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:31.964298 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d571078e-4838-40f9-8845-e2ac759bb6ad tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:32.026520 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-a776cf02-5809-4a15-aa10-deaa1aa24690 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:32.027254 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-a776cf02-5809-4a15-aa10-deaa1aa24690 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:32.036910 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-d571078e-4838-40f9-8845-e2ac759bb6ad tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094214 Sep 02 17:11:32.037498 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 267/521] 10.222.0.41 () {58 vars in 1302 bytes} [Thu Sep 2 17:11:31 2021] GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:11:32.063985 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a776cf02-5809-4a15-aa10-deaa1aa24690 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:32.064439 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a776cf02-5809-4a15-aa10-deaa1aa24690 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:32.065230 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a776cf02-5809-4a15-aa10-deaa1aa24690 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:32.072262 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a776cf02-5809-4a15-aa10-deaa1aa24690 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:32.301625 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-7758836a-d80b-4aba-a138-bb80653d3546 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:32.303667 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-7758836a-d80b-4aba-a138-bb80653d3546 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 90cb7d6a-93e4-427e-bdba-de422d89fa0f] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:32.313221 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7758836a-d80b-4aba-a138-bb80653d3546 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:32.314498 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7758836a-d80b-4aba-a138-bb80653d3546 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:32.327095 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7758836a-d80b-4aba-a138-bb80653d3546 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:32.327963 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7758836a-d80b-4aba-a138-bb80653d3546 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:32.359311 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-7758836a-d80b-4aba-a138-bb80653d3546 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 90cb7d6a-93e4-427e-bdba-de422d89fa0f] Going to try to terminate instance {{(pid=108417) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 17:11:32.410859 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-a776cf02-5809-4a15-aa10-deaa1aa24690 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:32.421961 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-a776cf02-5809-4a15-aa10-deaa1aa24690 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1568 microversion: 2.1 time: 0.401365 Sep 02 17:11:32.422766 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 255/522] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:32 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1568 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:32.466772 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-7758836a-d80b-4aba-a138-bb80653d3546 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "DELETE /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f" status: 204 len: 0 microversion: 2.1 time: 0.168233 Sep 02 17:11:32.471234 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 268/523] 10.222.0.41 () {58 vars in 1239 bytes} [Thu Sep 2 17:11:32 2021] DELETE /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 02 17:11:32.479682 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-deac0524-5528-462c-a15c-07bad1f1ebb7 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:32.480292 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-deac0524-5528-462c-a15c-07bad1f1ebb7 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 90cb7d6a-93e4-427e-bdba-de422d89fa0f] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:32.492457 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-deac0524-5528-462c-a15c-07bad1f1ebb7 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:32.492905 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-deac0524-5528-462c-a15c-07bad1f1ebb7 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:32.493903 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-deac0524-5528-462c-a15c-07bad1f1ebb7 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:32.494459 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-deac0524-5528-462c-a15c-07bad1f1ebb7 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:32.678221 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-36ff615d-3e99-4d21-a782-f82683ae5b2d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:32.679348 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-36ff615d-3e99-4d21-a782-f82683ae5b2d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:32.685900 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-36ff615d-3e99-4d21-a782-f82683ae5b2d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:32.686355 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-36ff615d-3e99-4d21-a782-f82683ae5b2d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:32.687316 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-36ff615d-3e99-4d21-a782-f82683ae5b2d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:32.687804 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-36ff615d-3e99-4d21-a782-f82683ae5b2d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:32.726858 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-deac0524-5528-462c-a15c-07bad1f1ebb7 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:32.736796 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-deac0524-5528-462c-a15c-07bad1f1ebb7 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f" status: 200 len: 1513 microversion: 2.1 time: 0.260500 Sep 02 17:11:32.737685 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 256/524] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:32 2021] GET /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f => generated 1513 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:32.752452 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-a9b50ed6-fff7-41fb-9e29-6412ecc120cc tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:32.753433 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-a9b50ed6-fff7-41fb-9e29-6412ecc120cc tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:32.762418 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a9b50ed6-fff7-41fb-9e29-6412ecc120cc tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:32.762971 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a9b50ed6-fff7-41fb-9e29-6412ecc120cc tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:32.763789 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a9b50ed6-fff7-41fb-9e29-6412ecc120cc tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:32.764220 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a9b50ed6-fff7-41fb-9e29-6412ecc120cc tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:32.898958 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-a9b50ed6-fff7-41fb-9e29-6412ecc120cc tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38165 microversion: 2.1 time: 0.146242 Sep 02 17:11:32.903218 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 257/525] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:11:32 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38165 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:11:32.924075 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-36ff615d-3e99-4d21-a782-f82683ae5b2d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:32.932687 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-36ff615d-3e99-4d21-a782-f82683ae5b2d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:32.935575 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-36ff615d-3e99-4d21-a782-f82683ae5b2d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:32.936779 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-36ff615d-3e99-4d21-a782-f82683ae5b2d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1722 microversion: 2.20 time: 0.264030 Sep 02 17:11:32.937337 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 269/526] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:11:32 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1722 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:11:33.048850 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-4ac53b19-5844-434e-849d-28eb2ad1b77b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:33.049979 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-4ac53b19-5844-434e-849d-28eb2ad1b77b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 422ee9ba-ea68-49c1-8704-16f3da2e809c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:33.056411 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4ac53b19-5844-434e-849d-28eb2ad1b77b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:33.057095 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4ac53b19-5844-434e-849d-28eb2ad1b77b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:33.058332 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4ac53b19-5844-434e-849d-28eb2ad1b77b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:33.059000 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4ac53b19-5844-434e-849d-28eb2ad1b77b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:33.090839 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-4ac53b19-5844-434e-849d-28eb2ad1b77b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046124 Sep 02 17:11:33.091636 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 270/527] 10.222.0.41 () {58 vars in 1302 bytes} [Thu Sep 2 17:11:33 2021] GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:11:33.243785 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-19b8ed82-6518-4b8c-af71-20df4fb1663d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Action: 'create', calling method: .version_select at 0x7fca9855ad30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1934407481"}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:33.262993 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.quota [None req-19b8ed82-6518-4b8c-af71-20df4fb1663d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Getting quotas for project dc090408372e41379709e2067823b1a6. Resources: {'key_pairs'} {{(pid=108418) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 17:11:33.266988 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.quota [None req-19b8ed82-6518-4b8c-af71-20df4fb1663d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Getting quotas for user 6df6e202f8b64bb0b33226402b65adaf and project dc090408372e41379709e2067823b1a6. Resources: {'key_pairs'} {{(pid=108418) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 17:11:33.371175 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.quota [None req-19b8ed82-6518-4b8c-af71-20df4fb1663d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Getting quotas for project dc090408372e41379709e2067823b1a6. Resources: {'key_pairs'} {{(pid=108418) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 17:11:33.384918 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.quota [None req-19b8ed82-6518-4b8c-af71-20df4fb1663d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Getting quotas for user 6df6e202f8b64bb0b33226402b65adaf and project dc090408372e41379709e2067823b1a6. Resources: {'key_pairs'} {{(pid=108418) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 17:11:33.388864 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-19b8ed82-6518-4b8c-af71-20df4fb1663d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.369426 Sep 02 17:11:33.389739 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 258/528] 10.222.0.41 () {60 vars in 1158 bytes} [Thu Sep 2 17:11:33 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:33.445589 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-e7b3388b-9f0f-4bfb-82b7-8b4219f30f0b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:33.445885 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-e7b3388b-9f0f-4bfb-82b7-8b4219f30f0b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:33.456135 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e7b3388b-9f0f-4bfb-82b7-8b4219f30f0b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:33.456731 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e7b3388b-9f0f-4bfb-82b7-8b4219f30f0b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:33.457501 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e7b3388b-9f0f-4bfb-82b7-8b4219f30f0b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:33.458139 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e7b3388b-9f0f-4bfb-82b7-8b4219f30f0b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:33.608022 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-e7b3388b-9f0f-4bfb-82b7-8b4219f30f0b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:33.622568 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-e7b3388b-9f0f-4bfb-82b7-8b4219f30f0b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1568 microversion: 2.1 time: 0.182844 Sep 02 17:11:33.623517 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 271/529] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:33 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:33.759688 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-07853708-d4a7-4660-819a-b7764cd6b929 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:33.759688 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-07853708-d4a7-4660-819a-b7764cd6b929 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 90cb7d6a-93e4-427e-bdba-de422d89fa0f] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:33.775933 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-07853708-d4a7-4660-819a-b7764cd6b929 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:33.776393 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-07853708-d4a7-4660-819a-b7764cd6b929 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:33.777184 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-07853708-d4a7-4660-819a-b7764cd6b929 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:33.777629 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-07853708-d4a7-4660-819a-b7764cd6b929 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:33.914041 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-200b36c3-bc71-4955-9c41-925bc0b4c318 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:33.915036 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-200b36c3-bc71-4955-9c41-925bc0b4c318 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:33.921401 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-200b36c3-bc71-4955-9c41-925bc0b4c318 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:33.921839 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-200b36c3-bc71-4955-9c41-925bc0b4c318 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:33.923126 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-200b36c3-bc71-4955-9c41-925bc0b4c318 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:33.923741 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-200b36c3-bc71-4955-9c41-925bc0b4c318 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:33.990642 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-07853708-d4a7-4660-819a-b7764cd6b929 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:33.998416 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-07853708-d4a7-4660-819a-b7764cd6b929 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f" status: 200 len: 1513 microversion: 2.1 time: 0.246937 Sep 02 17:11:33.998956 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 259/530] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:33 2021] GET /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f => generated 1513 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:34.005991 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-194ba1df-f411-4626-9f22-aaed9df2ae26 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:34.006590 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-194ba1df-f411-4626-9f22-aaed9df2ae26 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:34.012549 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-194ba1df-f411-4626-9f22-aaed9df2ae26 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:34.013002 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-194ba1df-f411-4626-9f22-aaed9df2ae26 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:34.013861 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-194ba1df-f411-4626-9f22-aaed9df2ae26 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:34.014305 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-194ba1df-f411-4626-9f22-aaed9df2ae26 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:34.045442 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-200b36c3-bc71-4955-9c41-925bc0b4c318 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38165 microversion: 2.1 time: 0.135807 Sep 02 17:11:34.046080 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 272/531] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:11:33 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38165 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:11:34.102443 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-56f6a91c-64a2-491b-99ac-89bb37ef5303 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:34.103532 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-56f6a91c-64a2-491b-99ac-89bb37ef5303 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 422ee9ba-ea68-49c1-8704-16f3da2e809c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:34.117458 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-56f6a91c-64a2-491b-99ac-89bb37ef5303 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:34.117948 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-56f6a91c-64a2-491b-99ac-89bb37ef5303 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:34.119047 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-56f6a91c-64a2-491b-99ac-89bb37ef5303 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:34.119483 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-56f6a91c-64a2-491b-99ac-89bb37ef5303 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:34.156001 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-56f6a91c-64a2-491b-99ac-89bb37ef5303 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058114 Sep 02 17:11:34.156822 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 273/532] 10.222.0.41 () {58 vars in 1302 bytes} [Thu Sep 2 17:11:34 2021] GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 17:11:34.168105 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-194ba1df-f411-4626-9f22-aaed9df2ae26 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:34.178538 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-194ba1df-f411-4626-9f22-aaed9df2ae26 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:34.180448 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-194ba1df-f411-4626-9f22-aaed9df2ae26 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:34.182349 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-194ba1df-f411-4626-9f22-aaed9df2ae26 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1722 microversion: 2.20 time: 0.182266 Sep 02 17:11:34.183141 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 260/533] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:11:33 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:11:34.639886 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-2621bad1-1ef8-470a-b091-82424a3feb7f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:34.641058 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-2621bad1-1ef8-470a-b091-82424a3feb7f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:34.647871 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2621bad1-1ef8-470a-b091-82424a3feb7f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:34.648317 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2621bad1-1ef8-470a-b091-82424a3feb7f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:34.649540 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2621bad1-1ef8-470a-b091-82424a3feb7f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:34.649838 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2621bad1-1ef8-470a-b091-82424a3feb7f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:34.786965 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-2621bad1-1ef8-470a-b091-82424a3feb7f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:34.798111 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-2621bad1-1ef8-470a-b091-82424a3feb7f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1568 microversion: 2.1 time: 0.161102 Sep 02 17:11:34.807704 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 274/534] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:34 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1568 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:35.016091 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-5159b7c3-db68-41a3-ba08-1866662c4d2c tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:35.016630 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-5159b7c3-db68-41a3-ba08-1866662c4d2c tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 90cb7d6a-93e4-427e-bdba-de422d89fa0f] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:35.025783 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5159b7c3-db68-41a3-ba08-1866662c4d2c tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:35.029357 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5159b7c3-db68-41a3-ba08-1866662c4d2c tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:35.030472 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5159b7c3-db68-41a3-ba08-1866662c4d2c tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:35.032437 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5159b7c3-db68-41a3-ba08-1866662c4d2c tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:35.057860 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-614c45dd-1ed3-427a-af95-698823b45bc5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:35.058849 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-614c45dd-1ed3-427a-af95-698823b45bc5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:35.077541 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-614c45dd-1ed3-427a-af95-698823b45bc5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:35.077990 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-614c45dd-1ed3-427a-af95-698823b45bc5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:35.078805 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-614c45dd-1ed3-427a-af95-698823b45bc5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:35.079236 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-614c45dd-1ed3-427a-af95-698823b45bc5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:35.274401 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-614c45dd-1ed3-427a-af95-698823b45bc5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38165 microversion: 2.1 time: 0.220170 Sep 02 17:11:35.276456 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 275/535] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:11:35 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38165 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:11:35.282959 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-7ae0930c-bfbb-41bd-9366-f62043b819d7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:35.284000 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-7ae0930c-bfbb-41bd-9366-f62043b819d7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:35.294908 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7ae0930c-bfbb-41bd-9366-f62043b819d7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:35.295599 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7ae0930c-bfbb-41bd-9366-f62043b819d7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:35.297085 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7ae0930c-bfbb-41bd-9366-f62043b819d7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:35.297901 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7ae0930c-bfbb-41bd-9366-f62043b819d7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:35.319314 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-5159b7c3-db68-41a3-ba08-1866662c4d2c tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:35.330614 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-5159b7c3-db68-41a3-ba08-1866662c4d2c tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f" status: 200 len: 1513 microversion: 2.1 time: 0.318938 Sep 02 17:11:35.331687 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 261/536] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:35 2021] GET /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f => generated 1513 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:35.414288 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-2abaf12a-0dfa-41df-bd5c-207b4d8b3301 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:35.416201 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-2abaf12a-0dfa-41df-bd5c-207b4d8b3301 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 422ee9ba-ea68-49c1-8704-16f3da2e809c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:35.425322 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2abaf12a-0dfa-41df-bd5c-207b4d8b3301 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:35.425779 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2abaf12a-0dfa-41df-bd5c-207b4d8b3301 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:35.426760 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2abaf12a-0dfa-41df-bd5c-207b4d8b3301 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:35.427377 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2abaf12a-0dfa-41df-bd5c-207b4d8b3301 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:35.475212 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-2abaf12a-0dfa-41df-bd5c-207b4d8b3301 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 422ee9ba-ea68-49c1-8704-16f3da2e809c] Going to try to terminate instance {{(pid=108418) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 17:11:35.530657 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-7ae0930c-bfbb-41bd-9366-f62043b819d7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:35.544461 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-7ae0930c-bfbb-41bd-9366-f62043b819d7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:35.550704 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-7ae0930c-bfbb-41bd-9366-f62043b819d7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:35.555536 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-7ae0930c-bfbb-41bd-9366-f62043b819d7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1743 microversion: 2.20 time: 0.276472 Sep 02 17:11:35.557159 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 276/537] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:11:35 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1743 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:11:35.603861 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-2abaf12a-0dfa-41df-bd5c-207b4d8b3301 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "DELETE /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c" status: 204 len: 0 microversion: 2.1 time: 0.196032 Sep 02 17:11:35.604879 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 262/538] 10.222.0.41 () {58 vars in 1239 bytes} [Thu Sep 2 17:11:35 2021] DELETE /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 17:11:35.615810 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-a43fdb7e-bd05-41c0-ba22-ddf344eb703a tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:35.619536 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-a43fdb7e-bd05-41c0-ba22-ddf344eb703a tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 422ee9ba-ea68-49c1-8704-16f3da2e809c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:35.627267 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a43fdb7e-bd05-41c0-ba22-ddf344eb703a tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:35.628061 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a43fdb7e-bd05-41c0-ba22-ddf344eb703a tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:35.629021 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a43fdb7e-bd05-41c0-ba22-ddf344eb703a tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:35.630025 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a43fdb7e-bd05-41c0-ba22-ddf344eb703a tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:35.795682 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-a43fdb7e-bd05-41c0-ba22-ddf344eb703a tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:35.805262 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-a43fdb7e-bd05-41c0-ba22-ddf344eb703a tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c" status: 200 len: 1514 microversion: 2.1 time: 0.196350 Sep 02 17:11:35.807220 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 277/539] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:35 2021] GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c => generated 1514 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:35.814862 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-45e3625b-e251-49f8-96eb-cfcdefbb0736 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:35.815824 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-45e3625b-e251-49f8-96eb-cfcdefbb0736 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:35.821694 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-45e3625b-e251-49f8-96eb-cfcdefbb0736 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:35.822147 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-45e3625b-e251-49f8-96eb-cfcdefbb0736 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:35.822967 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-45e3625b-e251-49f8-96eb-cfcdefbb0736 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:35.823405 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-45e3625b-e251-49f8-96eb-cfcdefbb0736 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:36.000879 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-45e3625b-e251-49f8-96eb-cfcdefbb0736 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:36.009414 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-45e3625b-e251-49f8-96eb-cfcdefbb0736 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1568 microversion: 2.1 time: 0.198598 Sep 02 17:11:36.013760 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 263/540] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:35 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1568 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:36.160567 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [req-8c7f01d0-4128-498b-99cc-35e444d54afb req-df450373-61f8-4254-8a5d-84bb3dd0a257 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90cb7d6a-93e4-427e-bdba-de422d89fa0f", "name": "network-vif-deleted", "tag": "e9dda3e8-e3cc-41ac-a8ce-42eacc3fc937"}]} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:36.162517 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:11:36.162517 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: warnings.warn(msg) Sep 02 17:11:36.178113 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-8c7f01d0-4128-498b-99cc-35e444d54afb req-df450373-61f8-4254-8a5d-84bb3dd0a257 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:36.179178 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-8c7f01d0-4128-498b-99cc-35e444d54afb req-df450373-61f8-4254-8a5d-84bb3dd0a257 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:36.193977 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.compute.server_external_events [req-8c7f01d0-4128-498b-99cc-35e444d54afb req-df450373-61f8-4254-8a5d-84bb3dd0a257 service nova] Creating event network-vif-deleted:e9dda3e8-e3cc-41ac-a8ce-42eacc3fc937 for instance 90cb7d6a-93e4-427e-bdba-de422d89fa0f on hv-cinder-80626 Sep 02 17:11:36.199357 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [req-8c7f01d0-4128-498b-99cc-35e444d54afb req-df450373-61f8-4254-8a5d-84bb3dd0a257 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045253 Sep 02 17:11:36.199954 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 278/541] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:11:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:11:36.286780 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-4740478a-f576-465c-80f8-e4d2128cf4f7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:36.289224 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-4740478a-f576-465c-80f8-e4d2128cf4f7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:36.295529 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4740478a-f576-465c-80f8-e4d2128cf4f7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:36.296603 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4740478a-f576-465c-80f8-e4d2128cf4f7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:36.297457 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4740478a-f576-465c-80f8-e4d2128cf4f7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:36.298263 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4740478a-f576-465c-80f8-e4d2128cf4f7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:36.348256 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-405b223c-5fb2-4025-a8c1-26d5783afb1c tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:36.348901 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-405b223c-5fb2-4025-a8c1-26d5783afb1c tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 90cb7d6a-93e4-427e-bdba-de422d89fa0f] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:36.357241 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-405b223c-5fb2-4025-a8c1-26d5783afb1c tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:36.357731 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-405b223c-5fb2-4025-a8c1-26d5783afb1c tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:36.362316 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-405b223c-5fb2-4025-a8c1-26d5783afb1c tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:36.362799 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-405b223c-5fb2-4025-a8c1-26d5783afb1c tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:36.427066 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-405b223c-5fb2-4025-a8c1-26d5783afb1c tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:36.436482 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-405b223c-5fb2-4025-a8c1-26d5783afb1c tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f" status: 200 len: 1304 microversion: 2.1 time: 0.092092 Sep 02 17:11:36.437268 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 279/542] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:36 2021] GET /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:11:36.575115 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-ea47bfb8-9c10-4011-b169-10728c0a2942 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:36.575713 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-ea47bfb8-9c10-4011-b169-10728c0a2942 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:36.581618 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ea47bfb8-9c10-4011-b169-10728c0a2942 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:36.582061 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ea47bfb8-9c10-4011-b169-10728c0a2942 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:36.582847 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ea47bfb8-9c10-4011-b169-10728c0a2942 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:36.583272 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ea47bfb8-9c10-4011-b169-10728c0a2942 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:36.706198 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-ea47bfb8-9c10-4011-b169-10728c0a2942 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:36.714381 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-ea47bfb8-9c10-4011-b169-10728c0a2942 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:36.715892 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-ea47bfb8-9c10-4011-b169-10728c0a2942 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:36.717196 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-ea47bfb8-9c10-4011-b169-10728c0a2942 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1743 microversion: 2.20 time: 0.145756 Sep 02 17:11:36.717875 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 280/543] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:11:36 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1743 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:11:36.822413 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-ccae7dfe-173b-4229-97a9-738fbc76f904 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:36.823072 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-ccae7dfe-173b-4229-97a9-738fbc76f904 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 422ee9ba-ea68-49c1-8704-16f3da2e809c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:36.829110 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ccae7dfe-173b-4229-97a9-738fbc76f904 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:36.829554 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ccae7dfe-173b-4229-97a9-738fbc76f904 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:36.830324 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ccae7dfe-173b-4229-97a9-738fbc76f904 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:36.830797 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ccae7dfe-173b-4229-97a9-738fbc76f904 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:36.973248 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-ccae7dfe-173b-4229-97a9-738fbc76f904 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:36.980714 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-ccae7dfe-173b-4229-97a9-738fbc76f904 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c" status: 200 len: 1514 microversion: 2.1 time: 0.161949 Sep 02 17:11:36.981289 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 281/544] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:36 2021] GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:11:37.029637 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-3516b86b-1b2f-4018-bc4e-c61427542e42 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:37.030243 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-3516b86b-1b2f-4018-bc4e-c61427542e42 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:37.036021 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3516b86b-1b2f-4018-bc4e-c61427542e42 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:37.036472 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3516b86b-1b2f-4018-bc4e-c61427542e42 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:37.037484 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3516b86b-1b2f-4018-bc4e-c61427542e42 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:37.037918 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3516b86b-1b2f-4018-bc4e-c61427542e42 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:37.168391 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-3516b86b-1b2f-4018-bc4e-c61427542e42 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:37.178003 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-3516b86b-1b2f-4018-bc4e-c61427542e42 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1568 microversion: 2.1 time: 0.151238 Sep 02 17:11:37.179543 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 282/545] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:37 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:11:37.453626 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-89625060-f213-4f8a-826f-d3ffec9f464f tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:37.454229 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-89625060-f213-4f8a-826f-d3ffec9f464f tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 90cb7d6a-93e4-427e-bdba-de422d89fa0f] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:37.460646 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-89625060-f213-4f8a-826f-d3ffec9f464f tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:37.461088 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-89625060-f213-4f8a-826f-d3ffec9f464f tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:37.461856 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-89625060-f213-4f8a-826f-d3ffec9f464f tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:37.462409 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-89625060-f213-4f8a-826f-d3ffec9f464f tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:37.523773 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-89625060-f213-4f8a-826f-d3ffec9f464f tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:37.532909 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-89625060-f213-4f8a-826f-d3ffec9f464f tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f" status: 200 len: 1304 microversion: 2.1 time: 0.083133 Sep 02 17:11:37.543707 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 283/546] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:37 2021] GET /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f => generated 1304 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:11:37.736830 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-afaf951e-2dce-4b10-bcb8-d4b79691df17 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:37.737470 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-afaf951e-2dce-4b10-bcb8-d4b79691df17 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:37.743478 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-afaf951e-2dce-4b10-bcb8-d4b79691df17 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:37.743928 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-afaf951e-2dce-4b10-bcb8-d4b79691df17 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:37.744703 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-afaf951e-2dce-4b10-bcb8-d4b79691df17 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:37.745136 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-afaf951e-2dce-4b10-bcb8-d4b79691df17 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:37.875972 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-afaf951e-2dce-4b10-bcb8-d4b79691df17 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:37.884702 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-afaf951e-2dce-4b10-bcb8-d4b79691df17 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:37.886194 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-afaf951e-2dce-4b10-bcb8-d4b79691df17 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:37.887411 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-afaf951e-2dce-4b10-bcb8-d4b79691df17 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1743 microversion: 2.20 time: 0.154595 Sep 02 17:11:37.887967 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 284/547] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:11:37 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:11:37.998304 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-37f97544-02ea-4312-aef5-0899b20a5e24 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:37.998957 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-37f97544-02ea-4312-aef5-0899b20a5e24 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 422ee9ba-ea68-49c1-8704-16f3da2e809c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:38.005271 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-37f97544-02ea-4312-aef5-0899b20a5e24 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:38.006254 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-37f97544-02ea-4312-aef5-0899b20a5e24 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:38.007069 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-37f97544-02ea-4312-aef5-0899b20a5e24 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:38.007552 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-37f97544-02ea-4312-aef5-0899b20a5e24 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:38.131496 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-37f97544-02ea-4312-aef5-0899b20a5e24 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:38.138920 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-37f97544-02ea-4312-aef5-0899b20a5e24 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c" status: 200 len: 1514 microversion: 2.1 time: 0.144268 Sep 02 17:11:38.139607 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 285/548] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:37 2021] GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c => generated 1514 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:11:38.197637 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-d66291c7-6f39-4ec4-a5d9-ff0a2d7ecee7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:38.198316 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-d66291c7-6f39-4ec4-a5d9-ff0a2d7ecee7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:38.204226 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d66291c7-6f39-4ec4-a5d9-ff0a2d7ecee7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:38.204693 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d66291c7-6f39-4ec4-a5d9-ff0a2d7ecee7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:38.205439 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d66291c7-6f39-4ec4-a5d9-ff0a2d7ecee7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:38.205860 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d66291c7-6f39-4ec4-a5d9-ff0a2d7ecee7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:38.332151 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-d66291c7-6f39-4ec4-a5d9-ff0a2d7ecee7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:38.340018 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-d66291c7-6f39-4ec4-a5d9-ff0a2d7ecee7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1568 microversion: 2.1 time: 0.146662 Sep 02 17:11:38.340573 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 286/549] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:38 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:11:38.550802 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-4c37397b-e2c7-4a48-8cd7-2423e0f61884 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:38.551404 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-4c37397b-e2c7-4a48-8cd7-2423e0f61884 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 90cb7d6a-93e4-427e-bdba-de422d89fa0f] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:38.558438 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4c37397b-e2c7-4a48-8cd7-2423e0f61884 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:38.558905 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4c37397b-e2c7-4a48-8cd7-2423e0f61884 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:38.559653 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4c37397b-e2c7-4a48-8cd7-2423e0f61884 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:38.560078 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4c37397b-e2c7-4a48-8cd7-2423e0f61884 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:38.624479 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-4c37397b-e2c7-4a48-8cd7-2423e0f61884 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:38.632213 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-4c37397b-e2c7-4a48-8cd7-2423e0f61884 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f" status: 200 len: 1304 microversion: 2.1 time: 0.084944 Sep 02 17:11:38.632895 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 287/550] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:38 2021] GET /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f => generated 1304 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:11:38.905320 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-e5ed580a-6fb6-4f29-86ff-485b32764246 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:38.905931 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-e5ed580a-6fb6-4f29-86ff-485b32764246 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:38.912713 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e5ed580a-6fb6-4f29-86ff-485b32764246 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:38.913172 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e5ed580a-6fb6-4f29-86ff-485b32764246 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:38.913943 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e5ed580a-6fb6-4f29-86ff-485b32764246 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:38.914375 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e5ed580a-6fb6-4f29-86ff-485b32764246 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:39.035456 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-e5ed580a-6fb6-4f29-86ff-485b32764246 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:39.044063 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-e5ed580a-6fb6-4f29-86ff-485b32764246 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:39.045569 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-e5ed580a-6fb6-4f29-86ff-485b32764246 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:39.046752 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-e5ed580a-6fb6-4f29-86ff-485b32764246 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1743 microversion: 2.20 time: 0.145275 Sep 02 17:11:39.047304 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 288/551] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:11:38 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1743 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:11:39.156828 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-b0bb9c94-52c5-4633-816d-fcff068f14ec tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:39.157484 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-b0bb9c94-52c5-4633-816d-fcff068f14ec tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 422ee9ba-ea68-49c1-8704-16f3da2e809c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:39.163510 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b0bb9c94-52c5-4633-816d-fcff068f14ec tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:39.163955 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b0bb9c94-52c5-4633-816d-fcff068f14ec tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:39.164726 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b0bb9c94-52c5-4633-816d-fcff068f14ec tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:39.165156 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b0bb9c94-52c5-4633-816d-fcff068f14ec tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:39.287347 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-b0bb9c94-52c5-4633-816d-fcff068f14ec tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:39.294867 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-b0bb9c94-52c5-4633-816d-fcff068f14ec tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c" status: 200 len: 1514 microversion: 2.1 time: 0.142826 Sep 02 17:11:39.295425 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 289/552] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:39 2021] GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c => generated 1514 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:11:39.356781 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-907beea8-8d3b-4684-abe5-94c7656b9821 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:39.357382 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-907beea8-8d3b-4684-abe5-94c7656b9821 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:39.363555 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-907beea8-8d3b-4684-abe5-94c7656b9821 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:39.363994 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-907beea8-8d3b-4684-abe5-94c7656b9821 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:39.364752 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-907beea8-8d3b-4684-abe5-94c7656b9821 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:39.365247 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-907beea8-8d3b-4684-abe5-94c7656b9821 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:39.490866 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-907beea8-8d3b-4684-abe5-94c7656b9821 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:39.498691 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-907beea8-8d3b-4684-abe5-94c7656b9821 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1568 microversion: 2.1 time: 0.145525 Sep 02 17:11:39.499252 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 290/553] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:39 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:11:39.648987 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-c2423b92-55e0-4012-8083-49787c696522 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:39.649588 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-c2423b92-55e0-4012-8083-49787c696522 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 90cb7d6a-93e4-427e-bdba-de422d89fa0f] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:39.655988 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c2423b92-55e0-4012-8083-49787c696522 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:39.656560 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c2423b92-55e0-4012-8083-49787c696522 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:39.657321 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c2423b92-55e0-4012-8083-49787c696522 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:39.657778 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c2423b92-55e0-4012-8083-49787c696522 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:39.687543 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c2423b92-55e0-4012-8083-49787c696522 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:39.687979 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c2423b92-55e0-4012-8083-49787c696522 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:39.688418 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.objects.instance [None req-c2423b92-55e0-4012-8083-49787c696522 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lazy-loading 'fault' on Instance uuid 90cb7d6a-93e4-427e-bdba-de422d89fa0f {{(pid=108417) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 17:11:39.728601 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-c2423b92-55e0-4012-8083-49787c696522 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:39.736044 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-c2423b92-55e0-4012-8083-49787c696522 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f" status: 200 len: 1309 microversion: 2.1 time: 0.090769 Sep 02 17:11:39.736883 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 291/554] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:39 2021] GET /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f => generated 1309 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:11:40.058450 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-4740478a-f576-465c-80f8-e4d2128cf4f7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38165 microversion: 2.1 time: 3.774839 Sep 02 17:11:40.059077 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 264/555] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:11:36 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38165 bytes in 3777 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:11:40.064204 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-bfc8f736-04c7-4c42-ad03-c82280e2d377 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:40.064804 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-bfc8f736-04c7-4c42-ad03-c82280e2d377 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:40.070597 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-bfc8f736-04c7-4c42-ad03-c82280e2d377 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:40.071069 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-bfc8f736-04c7-4c42-ad03-c82280e2d377 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:40.071813 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-bfc8f736-04c7-4c42-ad03-c82280e2d377 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:40.072237 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-bfc8f736-04c7-4c42-ad03-c82280e2d377 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:40.192726 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-bfc8f736-04c7-4c42-ad03-c82280e2d377 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:40.200453 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-bfc8f736-04c7-4c42-ad03-c82280e2d377 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:40.201934 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-bfc8f736-04c7-4c42-ad03-c82280e2d377 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:40.203116 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-bfc8f736-04c7-4c42-ad03-c82280e2d377 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1743 microversion: 2.20 time: 0.142662 Sep 02 17:11:40.203679 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 292/556] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:11:40 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1743 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:11:40.312072 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-bfed2cc9-2ebb-4aa9-ae62-fd8f20fb4595 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:40.312696 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-bfed2cc9-2ebb-4aa9-ae62-fd8f20fb4595 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 422ee9ba-ea68-49c1-8704-16f3da2e809c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:40.319122 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bfed2cc9-2ebb-4aa9-ae62-fd8f20fb4595 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:40.319572 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bfed2cc9-2ebb-4aa9-ae62-fd8f20fb4595 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:40.320333 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bfed2cc9-2ebb-4aa9-ae62-fd8f20fb4595 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:40.320769 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bfed2cc9-2ebb-4aa9-ae62-fd8f20fb4595 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:40.447616 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-bfed2cc9-2ebb-4aa9-ae62-fd8f20fb4595 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:40.455867 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-bfed2cc9-2ebb-4aa9-ae62-fd8f20fb4595 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c" status: 200 len: 1514 microversion: 2.1 time: 0.147859 Sep 02 17:11:40.456436 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 265/557] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:40 2021] GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c => generated 1514 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:40.515633 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-082e4e85-d5dc-4f69-90b0-05dd1d0f7d8b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:40.516263 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-082e4e85-d5dc-4f69-90b0-05dd1d0f7d8b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:40.522744 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-082e4e85-d5dc-4f69-90b0-05dd1d0f7d8b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:40.523196 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-082e4e85-d5dc-4f69-90b0-05dd1d0f7d8b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:40.523962 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-082e4e85-d5dc-4f69-90b0-05dd1d0f7d8b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:40.524402 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-082e4e85-d5dc-4f69-90b0-05dd1d0f7d8b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:40.656787 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-082e4e85-d5dc-4f69-90b0-05dd1d0f7d8b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:40.664878 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-082e4e85-d5dc-4f69-90b0-05dd1d0f7d8b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1568 microversion: 2.1 time: 0.152782 Sep 02 17:11:40.665748 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 293/558] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:40 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:40.753996 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-ad32865b-1582-45b3-b2b7-fb81c8d32cc0 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:40.754606 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-ad32865b-1582-45b3-b2b7-fb81c8d32cc0 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 90cb7d6a-93e4-427e-bdba-de422d89fa0f] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:40.760974 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ad32865b-1582-45b3-b2b7-fb81c8d32cc0 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:40.761422 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ad32865b-1582-45b3-b2b7-fb81c8d32cc0 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:40.762177 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ad32865b-1582-45b3-b2b7-fb81c8d32cc0 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:40.762609 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ad32865b-1582-45b3-b2b7-fb81c8d32cc0 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:40.777023 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.wsgi [None req-ad32865b-1582-45b3-b2b7-fb81c8d32cc0 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] HTTP exception thrown: Instance 90cb7d6a-93e4-427e-bdba-de422d89fa0f could not be found. Sep 02 17:11:40.777612 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-ad32865b-1582-45b3-b2b7-fb81c8d32cc0 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Returning 404 to user: Instance 90cb7d6a-93e4-427e-bdba-de422d89fa0f could not be found. {{(pid=108418) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:11:40.778439 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-ad32865b-1582-45b3-b2b7-fb81c8d32cc0 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f" status: 404 len: 111 microversion: 2.1 time: 0.028156 Sep 02 17:11:40.778993 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 266/559] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:40 2021] GET /compute/v2.1/servers/90cb7d6a-93e4-427e-bdba-de422d89fa0f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 17:11:41.070332 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-d73d269f-6e4d-4e75-9e56-3256d73dc8d4 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:41.071464 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-d73d269f-6e4d-4e75-9e56-3256d73dc8d4 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:41.077179 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d73d269f-6e4d-4e75-9e56-3256d73dc8d4 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:41.077667 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d73d269f-6e4d-4e75-9e56-3256d73dc8d4 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:41.078457 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d73d269f-6e4d-4e75-9e56-3256d73dc8d4 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:41.078915 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d73d269f-6e4d-4e75-9e56-3256d73dc8d4 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:41.184655 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-d73d269f-6e4d-4e75-9e56-3256d73dc8d4 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38165 microversion: 2.1 time: 0.118619 Sep 02 17:11:41.185570 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 294/560] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:11:41 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38165 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:11:41.221377 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-280dc074-b38c-4e98-979c-3fbfc3735d3e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:41.221981 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-280dc074-b38c-4e98-979c-3fbfc3735d3e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:41.227879 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-280dc074-b38c-4e98-979c-3fbfc3735d3e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:41.228329 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-280dc074-b38c-4e98-979c-3fbfc3735d3e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:41.229088 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-280dc074-b38c-4e98-979c-3fbfc3735d3e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:41.229516 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-280dc074-b38c-4e98-979c-3fbfc3735d3e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:41.474045 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-a1a9d3db-436a-4bc7-83f2-1f16eb264045 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:41.475281 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-a1a9d3db-436a-4bc7-83f2-1f16eb264045 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 422ee9ba-ea68-49c1-8704-16f3da2e809c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:41.483932 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a1a9d3db-436a-4bc7-83f2-1f16eb264045 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:41.484663 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a1a9d3db-436a-4bc7-83f2-1f16eb264045 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:41.485619 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a1a9d3db-436a-4bc7-83f2-1f16eb264045 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:41.486211 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a1a9d3db-436a-4bc7-83f2-1f16eb264045 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:41.593728 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-280dc074-b38c-4e98-979c-3fbfc3735d3e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:41.602745 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-280dc074-b38c-4e98-979c-3fbfc3735d3e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:41.604335 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-280dc074-b38c-4e98-979c-3fbfc3735d3e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:41.605500 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-280dc074-b38c-4e98-979c-3fbfc3735d3e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1743 microversion: 2.20 time: 0.387770 Sep 02 17:11:41.606047 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 267/561] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:11:41 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1743 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:11:41.650454 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-a1a9d3db-436a-4bc7-83f2-1f16eb264045 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:41.658865 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-a1a9d3db-436a-4bc7-83f2-1f16eb264045 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c" status: 200 len: 1514 microversion: 2.1 time: 0.188908 Sep 02 17:11:41.659449 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 295/562] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:41 2021] GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c => generated 1514 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:11:41.681836 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-9170c0d0-4a2a-4d68-b285-cda8be15977e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:41.682449 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-9170c0d0-4a2a-4d68-b285-cda8be15977e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:41.688537 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9170c0d0-4a2a-4d68-b285-cda8be15977e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:41.688983 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9170c0d0-4a2a-4d68-b285-cda8be15977e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:41.689816 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9170c0d0-4a2a-4d68-b285-cda8be15977e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:41.690249 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9170c0d0-4a2a-4d68-b285-cda8be15977e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:41.815153 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-9170c0d0-4a2a-4d68-b285-cda8be15977e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:41.824942 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-9170c0d0-4a2a-4d68-b285-cda8be15977e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1568 microversion: 2.1 time: 0.147276 Sep 02 17:11:41.825719 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 268/563] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:41 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1568 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:42.197722 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-6959181b-3c61-42c4-aee5-9658d52701bf tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:42.198668 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-6959181b-3c61-42c4-aee5-9658d52701bf tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:42.204796 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6959181b-3c61-42c4-aee5-9658d52701bf tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:42.205272 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6959181b-3c61-42c4-aee5-9658d52701bf tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:42.206039 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6959181b-3c61-42c4-aee5-9658d52701bf tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:42.206470 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6959181b-3c61-42c4-aee5-9658d52701bf tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:42.662137 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-8db453f8-8a3d-4cbb-96be-50e27fcf62cf tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:42.662776 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-8db453f8-8a3d-4cbb-96be-50e27fcf62cf tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:42.668570 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8db453f8-8a3d-4cbb-96be-50e27fcf62cf tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:42.669012 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8db453f8-8a3d-4cbb-96be-50e27fcf62cf tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:42.669776 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8db453f8-8a3d-4cbb-96be-50e27fcf62cf tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:42.670208 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8db453f8-8a3d-4cbb-96be-50e27fcf62cf tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:42.787563 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-8db453f8-8a3d-4cbb-96be-50e27fcf62cf tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:42.795265 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-8db453f8-8a3d-4cbb-96be-50e27fcf62cf tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:42.796703 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-8db453f8-8a3d-4cbb-96be-50e27fcf62cf tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:42.797854 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-8db453f8-8a3d-4cbb-96be-50e27fcf62cf tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1738 microversion: 2.20 time: 0.139412 Sep 02 17:11:42.798395 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 269/564] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:11:42 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1738 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:11:42.803146 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-ad296355-433e-4771-ab15-ffd982b5e66b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:42.803790 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-ad296355-433e-4771-ab15-ffd982b5e66b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 422ee9ba-ea68-49c1-8704-16f3da2e809c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:42.809381 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ad296355-433e-4771-ab15-ffd982b5e66b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:42.809827 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ad296355-433e-4771-ab15-ffd982b5e66b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:42.810586 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ad296355-433e-4771-ab15-ffd982b5e66b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:42.811059 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ad296355-433e-4771-ab15-ffd982b5e66b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:42.941787 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-ad296355-433e-4771-ab15-ffd982b5e66b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:42.949106 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-ad296355-433e-4771-ab15-ffd982b5e66b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c" status: 200 len: 1514 microversion: 2.1 time: 0.149753 Sep 02 17:11:42.949668 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 270/565] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:42 2021] GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:42.954739 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-70ef5a3b-3e34-4461-937c-11309923f8c1 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:42.954739 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-70ef5a3b-3e34-4461-937c-11309923f8c1 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:42.959718 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-70ef5a3b-3e34-4461-937c-11309923f8c1 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:42.960167 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-70ef5a3b-3e34-4461-937c-11309923f8c1 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:42.960916 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-70ef5a3b-3e34-4461-937c-11309923f8c1 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:42.961346 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-70ef5a3b-3e34-4461-937c-11309923f8c1 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:43.080748 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-70ef5a3b-3e34-4461-937c-11309923f8c1 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:43.088396 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-70ef5a3b-3e34-4461-937c-11309923f8c1 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1568 microversion: 2.1 time: 0.137779 Sep 02 17:11:43.088998 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 271/566] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:42 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1568 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:43.809769 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-c3a6748f-8e60-4832-a77e-eb26a6528890 req-2ab13883-9baa-4ef9-9f6e-5108a4e76003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e92c68a-a864-4562-b08b-d244394268ce", "name": "network-vif-plugged", "status": "completed", "tag": "0a87c875-7882-47c2-a092-e14ea53f2b64"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:43.811542 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:11:43.811542 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:11:43.819783 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-c3a6748f-8e60-4832-a77e-eb26a6528890 req-2ab13883-9baa-4ef9-9f6e-5108a4e76003 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:43.820454 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-c3a6748f-8e60-4832-a77e-eb26a6528890 req-2ab13883-9baa-4ef9-9f6e-5108a4e76003 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:43.835785 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-c3a6748f-8e60-4832-a77e-eb26a6528890 req-2ab13883-9baa-4ef9-9f6e-5108a4e76003 service nova] Creating event network-vif-plugged:0a87c875-7882-47c2-a092-e14ea53f2b64 for instance 4e92c68a-a864-4562-b08b-d244394268ce on hv-cinder-80626 Sep 02 17:11:43.840790 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-c3a6748f-8e60-4832-a77e-eb26a6528890 req-2ab13883-9baa-4ef9-9f6e-5108a4e76003 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034559 Sep 02 17:11:43.841565 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 272/567] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:11:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:11:43.868225 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-b30d4876-3718-4a2b-b9c2-b20f84fe91da tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:43.868969 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-b30d4876-3718-4a2b-b9c2-b20f84fe91da tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:43.875654 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b30d4876-3718-4a2b-b9c2-b20f84fe91da tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:43.876068 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b30d4876-3718-4a2b-b9c2-b20f84fe91da tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:43.876790 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b30d4876-3718-4a2b-b9c2-b20f84fe91da tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:43.877258 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b30d4876-3718-4a2b-b9c2-b20f84fe91da tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:44.007132 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-b30d4876-3718-4a2b-b9c2-b20f84fe91da tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:44.015424 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-b30d4876-3718-4a2b-b9c2-b20f84fe91da tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:44.016905 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-b30d4876-3718-4a2b-b9c2-b20f84fe91da tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:44.018048 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-b30d4876-3718-4a2b-b9c2-b20f84fe91da tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1738 microversion: 2.20 time: 0.159612 Sep 02 17:11:44.018750 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 273/568] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:11:43 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:11:44.024904 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-375e0ea6-00d3-43c8-bf71-841c3e77ebce tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:44.025694 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-375e0ea6-00d3-43c8-bf71-841c3e77ebce tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 422ee9ba-ea68-49c1-8704-16f3da2e809c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:44.031641 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-375e0ea6-00d3-43c8-bf71-841c3e77ebce tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:44.032082 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-375e0ea6-00d3-43c8-bf71-841c3e77ebce tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:44.032863 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-375e0ea6-00d3-43c8-bf71-841c3e77ebce tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:44.033288 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-375e0ea6-00d3-43c8-bf71-841c3e77ebce tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:44.156180 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-375e0ea6-00d3-43c8-bf71-841c3e77ebce tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:44.163383 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-375e0ea6-00d3-43c8-bf71-841c3e77ebce tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c" status: 200 len: 1514 microversion: 2.1 time: 0.142925 Sep 02 17:11:44.163936 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 274/569] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:44 2021] GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c => generated 1514 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:44.168133 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-2c8dad09-e607-435e-b108-eb230826d4cc tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:44.168733 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-2c8dad09-e607-435e-b108-eb230826d4cc tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:44.174193 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2c8dad09-e607-435e-b108-eb230826d4cc tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:44.174661 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2c8dad09-e607-435e-b108-eb230826d4cc tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:44.175417 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2c8dad09-e607-435e-b108-eb230826d4cc tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:44.175853 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2c8dad09-e607-435e-b108-eb230826d4cc tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:44.296295 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-2c8dad09-e607-435e-b108-eb230826d4cc tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:44.304495 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-2c8dad09-e607-435e-b108-eb230826d4cc tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1568 microversion: 2.1 time: 0.139636 Sep 02 17:11:44.305042 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 275/570] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:44 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1568 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:44.874135 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-6959181b-3c61-42c4-aee5-9658d52701bf tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38165 microversion: 2.1 time: 2.681035 Sep 02 17:11:44.882337 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 296/571] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:11:42 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38165 bytes in 2683 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:11:45.037573 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-c7f4efe1-fe42-446f-aad6-1218824710aa tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:45.038262 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-c7f4efe1-fe42-446f-aad6-1218824710aa tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:45.046017 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c7f4efe1-fe42-446f-aad6-1218824710aa tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:45.046909 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c7f4efe1-fe42-446f-aad6-1218824710aa tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:45.048073 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c7f4efe1-fe42-446f-aad6-1218824710aa tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:45.049132 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c7f4efe1-fe42-446f-aad6-1218824710aa tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:45.181921 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-b0825f3f-f435-470d-a46b-5d317dc5190b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:45.183353 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-c7f4efe1-fe42-446f-aad6-1218824710aa tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:45.187430 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-b0825f3f-f435-470d-a46b-5d317dc5190b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 422ee9ba-ea68-49c1-8704-16f3da2e809c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:45.191477 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-c7f4efe1-fe42-446f-aad6-1218824710aa tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:45.193445 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-c7f4efe1-fe42-446f-aad6-1218824710aa tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:45.194765 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-c7f4efe1-fe42-446f-aad6-1218824710aa tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1738 microversion: 2.20 time: 0.161896 Sep 02 17:11:45.195763 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 276/572] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:11:45 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:11:45.211646 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b0825f3f-f435-470d-a46b-5d317dc5190b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:45.212475 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b0825f3f-f435-470d-a46b-5d317dc5190b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:45.213449 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b0825f3f-f435-470d-a46b-5d317dc5190b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:45.213900 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b0825f3f-f435-470d-a46b-5d317dc5190b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:45.322176 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-1cbaa37f-9fc6-49b5-9116-a7dc0ce757e9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:45.322848 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-1cbaa37f-9fc6-49b5-9116-a7dc0ce757e9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:45.329183 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1cbaa37f-9fc6-49b5-9116-a7dc0ce757e9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:45.330025 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1cbaa37f-9fc6-49b5-9116-a7dc0ce757e9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:45.331369 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1cbaa37f-9fc6-49b5-9116-a7dc0ce757e9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:45.332002 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1cbaa37f-9fc6-49b5-9116-a7dc0ce757e9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:45.371699 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-b0825f3f-f435-470d-a46b-5d317dc5190b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:45.390007 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-b0825f3f-f435-470d-a46b-5d317dc5190b tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c" status: 200 len: 1514 microversion: 2.1 time: 0.212664 Sep 02 17:11:45.391384 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 297/573] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:45 2021] GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c => generated 1514 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:11:45.506428 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-1cbaa37f-9fc6-49b5-9116-a7dc0ce757e9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:45.514960 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-1cbaa37f-9fc6-49b5-9116-a7dc0ce757e9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1568 microversion: 2.1 time: 0.197268 Sep 02 17:11:45.515556 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 277/574] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:45 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1568 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:45.887476 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-990f66aa-3070-4879-909a-d5b71e4be596 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:45.888399 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-990f66aa-3070-4879-909a-d5b71e4be596 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:45.896317 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-990f66aa-3070-4879-909a-d5b71e4be596 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:45.898388 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-990f66aa-3070-4879-909a-d5b71e4be596 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:45.904657 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-990f66aa-3070-4879-909a-d5b71e4be596 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:45.905271 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-990f66aa-3070-4879-909a-d5b71e4be596 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:46.069000 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-990f66aa-3070-4879-909a-d5b71e4be596 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38165 microversion: 2.1 time: 0.185752 Sep 02 17:11:46.070215 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 298/575] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:11:45 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38165 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:11:46.217224 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-824afebe-f38c-420d-ba7e-59500605f541 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:46.217844 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-824afebe-f38c-420d-ba7e-59500605f541 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:46.235064 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-824afebe-f38c-420d-ba7e-59500605f541 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:46.235539 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-824afebe-f38c-420d-ba7e-59500605f541 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:46.236321 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-824afebe-f38c-420d-ba7e-59500605f541 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:46.237094 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-824afebe-f38c-420d-ba7e-59500605f541 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:46.428427 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-52da08c7-4ba5-4b31-88c6-1a0eeb1ff363 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:46.429146 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-52da08c7-4ba5-4b31-88c6-1a0eeb1ff363 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 422ee9ba-ea68-49c1-8704-16f3da2e809c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:46.437137 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-52da08c7-4ba5-4b31-88c6-1a0eeb1ff363 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:46.437595 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-52da08c7-4ba5-4b31-88c6-1a0eeb1ff363 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:46.438608 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-52da08c7-4ba5-4b31-88c6-1a0eeb1ff363 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:46.439078 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-52da08c7-4ba5-4b31-88c6-1a0eeb1ff363 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:46.573545 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-52da08c7-4ba5-4b31-88c6-1a0eeb1ff363 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:46.583679 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-52da08c7-4ba5-4b31-88c6-1a0eeb1ff363 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c" status: 200 len: 1472 microversion: 2.1 time: 0.160948 Sep 02 17:11:46.584581 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 299/576] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:46 2021] GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c => generated 1472 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:46.604988 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-30c7f6b5-7ec1-4b62-a810-a2411e4753d0 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:46.616030 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-30c7f6b5-7ec1-4b62-a810-a2411e4753d0 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:46.635681 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-30c7f6b5-7ec1-4b62-a810-a2411e4753d0 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:46.639034 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-30c7f6b5-7ec1-4b62-a810-a2411e4753d0 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:46.640377 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-30c7f6b5-7ec1-4b62-a810-a2411e4753d0 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:46.640981 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-30c7f6b5-7ec1-4b62-a810-a2411e4753d0 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:46.705048 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-824afebe-f38c-420d-ba7e-59500605f541 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:46.716102 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-824afebe-f38c-420d-ba7e-59500605f541 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:46.718016 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-824afebe-f38c-420d-ba7e-59500605f541 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:46.720241 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-824afebe-f38c-420d-ba7e-59500605f541 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1738 microversion: 2.20 time: 0.506909 Sep 02 17:11:46.722235 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 278/577] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:11:46 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1738 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:11:46.728352 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-2beb5ef2-645a-422b-915f-6e8c92cfb686 req-3474dc4d-1ef2-427a-a3f8-7dcdd33dd3dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "422ee9ba-ea68-49c1-8704-16f3da2e809c", "name": "network-vif-deleted", "tag": "b84c05c6-edce-4eb5-954d-fdf2e1e3e9a1"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:46.731959 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:11:46.731959 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:11:46.746189 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-2beb5ef2-645a-422b-915f-6e8c92cfb686 req-3474dc4d-1ef2-427a-a3f8-7dcdd33dd3dc service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:46.747039 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-2beb5ef2-645a-422b-915f-6e8c92cfb686 req-3474dc4d-1ef2-427a-a3f8-7dcdd33dd3dc service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:46.805231 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-2beb5ef2-645a-422b-915f-6e8c92cfb686 req-3474dc4d-1ef2-427a-a3f8-7dcdd33dd3dc service nova] Creating event network-vif-deleted:b84c05c6-edce-4eb5-954d-fdf2e1e3e9a1 for instance 422ee9ba-ea68-49c1-8704-16f3da2e809c on hv-cinder-80626 Sep 02 17:11:46.851714 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-2beb5ef2-645a-422b-915f-6e8c92cfb686 req-3474dc4d-1ef2-427a-a3f8-7dcdd33dd3dc service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124298 Sep 02 17:11:46.854284 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 279/578] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:11:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:11:47.030936 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-30c7f6b5-7ec1-4b62-a810-a2411e4753d0 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:47.041001 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-30c7f6b5-7ec1-4b62-a810-a2411e4753d0 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1568 microversion: 2.1 time: 0.454316 Sep 02 17:11:47.042173 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 300/579] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:46 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1568 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:47.083162 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-4a274ceb-6f0d-4beb-a4d2-1815b73ebf95 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:47.084778 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-4a274ceb-6f0d-4beb-a4d2-1815b73ebf95 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:47.092820 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4a274ceb-6f0d-4beb-a4d2-1815b73ebf95 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:47.093588 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4a274ceb-6f0d-4beb-a4d2-1815b73ebf95 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:47.095096 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4a274ceb-6f0d-4beb-a4d2-1815b73ebf95 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:47.095699 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4a274ceb-6f0d-4beb-a4d2-1815b73ebf95 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:47.242191 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-4a274ceb-6f0d-4beb-a4d2-1815b73ebf95 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38165 microversion: 2.1 time: 0.164073 Sep 02 17:11:47.243002 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 280/580] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:11:47 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38165 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:11:47.601589 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-291e4e41-55ea-4165-a1be-e8fa7c9331b0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:47.602205 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-291e4e41-55ea-4165-a1be-e8fa7c9331b0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 422ee9ba-ea68-49c1-8704-16f3da2e809c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:47.616133 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-291e4e41-55ea-4165-a1be-e8fa7c9331b0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:47.616585 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-291e4e41-55ea-4165-a1be-e8fa7c9331b0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:47.617370 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-291e4e41-55ea-4165-a1be-e8fa7c9331b0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:47.617805 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-291e4e41-55ea-4165-a1be-e8fa7c9331b0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:47.650104 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.wsgi [None req-291e4e41-55ea-4165-a1be-e8fa7c9331b0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] HTTP exception thrown: Instance 422ee9ba-ea68-49c1-8704-16f3da2e809c could not be found. Sep 02 17:11:47.651875 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-291e4e41-55ea-4165-a1be-e8fa7c9331b0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Returning 404 to user: Instance 422ee9ba-ea68-49c1-8704-16f3da2e809c could not be found. {{(pid=108417) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:11:47.653371 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-291e4e41-55ea-4165-a1be-e8fa7c9331b0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c" status: 404 len: 111 microversion: 2.1 time: 0.056577 Sep 02 17:11:47.657428 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 301/581] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:47 2021] GET /compute/v2.1/servers/422ee9ba-ea68-49c1-8704-16f3da2e809c => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 17:11:47.741921 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-1c93693c-4489-4173-87d2-cce96a64dc24 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:47.743032 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-1c93693c-4489-4173-87d2-cce96a64dc24 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:47.753647 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1c93693c-4489-4173-87d2-cce96a64dc24 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:47.754442 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1c93693c-4489-4173-87d2-cce96a64dc24 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:47.755780 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1c93693c-4489-4173-87d2-cce96a64dc24 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:47.756430 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1c93693c-4489-4173-87d2-cce96a64dc24 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:48.038268 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-1c93693c-4489-4173-87d2-cce96a64dc24 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:48.056910 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-1c93693c-4489-4173-87d2-cce96a64dc24 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:48.059008 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-1c93693c-4489-4173-87d2-cce96a64dc24 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:48.060406 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-1c93693c-4489-4173-87d2-cce96a64dc24 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1738 microversion: 2.20 time: 0.323743 Sep 02 17:11:48.061149 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 281/582] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:11:47 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1738 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:11:48.064072 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-c3936ede-7d32-4cc5-9f17-d14be144ff0f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:48.064693 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-c3936ede-7d32-4cc5-9f17-d14be144ff0f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:48.073284 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c3936ede-7d32-4cc5-9f17-d14be144ff0f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:48.073735 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c3936ede-7d32-4cc5-9f17-d14be144ff0f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:48.074536 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c3936ede-7d32-4cc5-9f17-d14be144ff0f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:48.074978 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c3936ede-7d32-4cc5-9f17-d14be144ff0f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:48.259111 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-5b4f4546-84b1-4249-897a-2a582d8ceb72 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:48.260927 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-5b4f4546-84b1-4249-897a-2a582d8ceb72 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:48.273244 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5b4f4546-84b1-4249-897a-2a582d8ceb72 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:48.275984 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5b4f4546-84b1-4249-897a-2a582d8ceb72 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:48.276850 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5b4f4546-84b1-4249-897a-2a582d8ceb72 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:48.280638 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5b4f4546-84b1-4249-897a-2a582d8ceb72 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:48.356375 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-c3936ede-7d32-4cc5-9f17-d14be144ff0f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:48.403993 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-c3936ede-7d32-4cc5-9f17-d14be144ff0f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1568 microversion: 2.1 time: 0.345562 Sep 02 17:11:48.406828 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 302/583] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:48 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1568 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:48.539206 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-5b4f4546-84b1-4249-897a-2a582d8ceb72 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38165 microversion: 2.1 time: 0.285281 Sep 02 17:11:48.539846 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 282/584] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:11:48 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38165 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:11:48.835652 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-68617da0-9f4b-42d9-af37-3983777f0cb8 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:48.836466 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-68617da0-9f4b-42d9-af37-3983777f0cb8 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 824de352-7b8c-4ab6-8e42-1958f7b70c25] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:48.843263 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-68617da0-9f4b-42d9-af37-3983777f0cb8 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:48.845001 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-68617da0-9f4b-42d9-af37-3983777f0cb8 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:48.846050 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-68617da0-9f4b-42d9-af37-3983777f0cb8 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:48.846940 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-68617da0-9f4b-42d9-af37-3983777f0cb8 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:48.888180 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-68617da0-9f4b-42d9-af37-3983777f0cb8 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 824de352-7b8c-4ab6-8e42-1958f7b70c25] Going to try to terminate instance {{(pid=108417) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 17:11:48.988472 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-68617da0-9f4b-42d9-af37-3983777f0cb8 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "DELETE /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25" status: 204 len: 0 microversion: 2.1 time: 0.156683 Sep 02 17:11:48.989323 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 303/585] 10.222.0.41 () {58 vars in 1239 bytes} [Thu Sep 2 17:11:48 2021] DELETE /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 17:11:48.998404 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-b188298b-7d16-49a9-87bd-fca86c2d61d0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:48.999145 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-b188298b-7d16-49a9-87bd-fca86c2d61d0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 824de352-7b8c-4ab6-8e42-1958f7b70c25] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:49.006591 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b188298b-7d16-49a9-87bd-fca86c2d61d0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:49.007073 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b188298b-7d16-49a9-87bd-fca86c2d61d0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:49.007874 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b188298b-7d16-49a9-87bd-fca86c2d61d0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:49.008316 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b188298b-7d16-49a9-87bd-fca86c2d61d0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:49.079683 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-da895acd-cb5b-4fe1-b18f-c2ba649f48c4 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:49.082028 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-da895acd-cb5b-4fe1-b18f-c2ba649f48c4 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:49.094336 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-da895acd-cb5b-4fe1-b18f-c2ba649f48c4 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:49.094805 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-da895acd-cb5b-4fe1-b18f-c2ba649f48c4 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:49.107550 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-da895acd-cb5b-4fe1-b18f-c2ba649f48c4 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:49.108248 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-da895acd-cb5b-4fe1-b18f-c2ba649f48c4 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:49.164516 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-b188298b-7d16-49a9-87bd-fca86c2d61d0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:49.173563 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-b188298b-7d16-49a9-87bd-fca86c2d61d0 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25" status: 200 len: 1514 microversion: 2.1 time: 0.179175 Sep 02 17:11:49.174446 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 283/586] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:48 2021] GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25 => generated 1514 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:49.299579 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-da895acd-cb5b-4fe1-b18f-c2ba649f48c4 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:49.311122 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-da895acd-cb5b-4fe1-b18f-c2ba649f48c4 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:49.312648 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-da895acd-cb5b-4fe1-b18f-c2ba649f48c4 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:49.313869 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-da895acd-cb5b-4fe1-b18f-c2ba649f48c4 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1738 microversion: 2.20 time: 0.238243 Sep 02 17:11:49.314889 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 304/587] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:11:49 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1738 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:11:49.439405 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-e2f0a48d-72b5-46aa-902e-67e50cb54e31 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:49.440270 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-e2f0a48d-72b5-46aa-902e-67e50cb54e31 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:49.447099 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e2f0a48d-72b5-46aa-902e-67e50cb54e31 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:49.447674 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e2f0a48d-72b5-46aa-902e-67e50cb54e31 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:49.448555 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e2f0a48d-72b5-46aa-902e-67e50cb54e31 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:49.449092 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e2f0a48d-72b5-46aa-902e-67e50cb54e31 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:49.554414 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-9093cb6f-08e3-4d1d-b25a-225f2ee008ad tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:49.555413 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-9093cb6f-08e3-4d1d-b25a-225f2ee008ad tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:49.563483 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9093cb6f-08e3-4d1d-b25a-225f2ee008ad tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:49.564021 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9093cb6f-08e3-4d1d-b25a-225f2ee008ad tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:49.565015 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9093cb6f-08e3-4d1d-b25a-225f2ee008ad tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:49.565519 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9093cb6f-08e3-4d1d-b25a-225f2ee008ad tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:49.614682 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-e2f0a48d-72b5-46aa-902e-67e50cb54e31 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:49.627352 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-e2f0a48d-72b5-46aa-902e-67e50cb54e31 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1568 microversion: 2.1 time: 0.187619 Sep 02 17:11:49.628565 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 284/588] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:49 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1568 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:50.190919 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-59150a30-6caf-490f-9a3d-610e522b3e7d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:50.191611 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-59150a30-6caf-490f-9a3d-610e522b3e7d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 824de352-7b8c-4ab6-8e42-1958f7b70c25] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:50.198616 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-59150a30-6caf-490f-9a3d-610e522b3e7d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:50.199315 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-59150a30-6caf-490f-9a3d-610e522b3e7d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:50.200252 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-59150a30-6caf-490f-9a3d-610e522b3e7d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:50.200853 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-59150a30-6caf-490f-9a3d-610e522b3e7d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:50.336604 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-59150a30-6caf-490f-9a3d-610e522b3e7d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:50.346922 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-59150a30-6caf-490f-9a3d-610e522b3e7d tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25" status: 200 len: 1514 microversion: 2.1 time: 0.158291 Sep 02 17:11:50.355270 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 285/589] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:50 2021] GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:11:50.360205 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-21581f2c-01de-4b2e-abdf-22bebcfd9c86 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:50.360956 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-21581f2c-01de-4b2e-abdf-22bebcfd9c86 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:50.367919 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-21581f2c-01de-4b2e-abdf-22bebcfd9c86 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:50.368518 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-21581f2c-01de-4b2e-abdf-22bebcfd9c86 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:50.369402 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-21581f2c-01de-4b2e-abdf-22bebcfd9c86 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:50.369940 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-21581f2c-01de-4b2e-abdf-22bebcfd9c86 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:50.527970 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-21581f2c-01de-4b2e-abdf-22bebcfd9c86 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:50.537289 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-21581f2c-01de-4b2e-abdf-22bebcfd9c86 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:50.539975 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-21581f2c-01de-4b2e-abdf-22bebcfd9c86 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:50.541382 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-21581f2c-01de-4b2e-abdf-22bebcfd9c86 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1738 microversion: 2.20 time: 0.185000 Sep 02 17:11:50.541933 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 286/590] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:11:50 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:11:50.650078 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-2b9b0b04-0b41-486c-aab6-29eb9720625f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:50.650935 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-2b9b0b04-0b41-486c-aab6-29eb9720625f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:50.657532 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2b9b0b04-0b41-486c-aab6-29eb9720625f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:50.658420 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2b9b0b04-0b41-486c-aab6-29eb9720625f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:50.659494 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2b9b0b04-0b41-486c-aab6-29eb9720625f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:50.660240 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2b9b0b04-0b41-486c-aab6-29eb9720625f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:50.814952 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-2b9b0b04-0b41-486c-aab6-29eb9720625f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:50.824434 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-2b9b0b04-0b41-486c-aab6-29eb9720625f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1568 microversion: 2.1 time: 0.181184 Sep 02 17:11:50.825632 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 287/591] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:50 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1568 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:51.361398 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-210af38b-3f91-43c2-b0b8-3ce0d663c88f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:51.362200 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-210af38b-3f91-43c2-b0b8-3ce0d663c88f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 824de352-7b8c-4ab6-8e42-1958f7b70c25] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:51.368765 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-210af38b-3f91-43c2-b0b8-3ce0d663c88f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:51.369273 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-210af38b-3f91-43c2-b0b8-3ce0d663c88f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:51.370265 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-210af38b-3f91-43c2-b0b8-3ce0d663c88f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:51.370787 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-210af38b-3f91-43c2-b0b8-3ce0d663c88f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:51.519960 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-210af38b-3f91-43c2-b0b8-3ce0d663c88f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:51.529791 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-210af38b-3f91-43c2-b0b8-3ce0d663c88f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25" status: 200 len: 1514 microversion: 2.1 time: 0.172126 Sep 02 17:11:51.541278 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 288/592] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:51 2021] GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25 => generated 1514 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:11:51.566242 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-fae8a7b2-0494-4575-bdd1-433933814855 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:51.567068 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-fae8a7b2-0494-4575-bdd1-433933814855 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:51.573653 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fae8a7b2-0494-4575-bdd1-433933814855 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:51.574122 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fae8a7b2-0494-4575-bdd1-433933814855 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:51.575372 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fae8a7b2-0494-4575-bdd1-433933814855 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:51.575816 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fae8a7b2-0494-4575-bdd1-433933814855 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:51.728236 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-fae8a7b2-0494-4575-bdd1-433933814855 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:51.739083 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-fae8a7b2-0494-4575-bdd1-433933814855 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:51.741164 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-fae8a7b2-0494-4575-bdd1-433933814855 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:51.742338 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-fae8a7b2-0494-4575-bdd1-433933814855 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1738 microversion: 2.20 time: 0.180730 Sep 02 17:11:51.742912 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 289/593] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:11:51 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:11:51.760614 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-9093cb6f-08e3-4d1d-b25a-225f2ee008ad tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38165 microversion: 2.1 time: 2.210829 Sep 02 17:11:51.762832 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 305/594] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:11:49 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38165 bytes in 2214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:11:51.842598 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-4a52f70b-9bd3-4e32-86b9-6555b8e06e19 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:51.843357 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-4a52f70b-9bd3-4e32-86b9-6555b8e06e19 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:51.850097 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4a52f70b-9bd3-4e32-86b9-6555b8e06e19 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:51.850545 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4a52f70b-9bd3-4e32-86b9-6555b8e06e19 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:51.851631 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4a52f70b-9bd3-4e32-86b9-6555b8e06e19 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:51.852065 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4a52f70b-9bd3-4e32-86b9-6555b8e06e19 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:51.997157 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-4a52f70b-9bd3-4e32-86b9-6555b8e06e19 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:52.006709 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-4a52f70b-9bd3-4e32-86b9-6555b8e06e19 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1568 microversion: 2.1 time: 0.167788 Sep 02 17:11:52.007296 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 290/595] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:51 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:52.287406 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-b238e696-4ecc-4585-b9ff-dc3010a92995 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-493164687", "imageRef": "22ce6e29-f3a7-49f0-b93a-ddbffa14e44e", "flavorRef": "452", "networks": [{"uuid": "66d8eb5c-183b-4388-baa3-2c614c901226"}]}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:52.548148 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-7beb63ac-f5ec-442a-afea-1a582c18aef3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:52.548751 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-7beb63ac-f5ec-442a-afea-1a582c18aef3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 824de352-7b8c-4ab6-8e42-1958f7b70c25] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:52.556550 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7beb63ac-f5ec-442a-afea-1a582c18aef3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:52.557230 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7beb63ac-f5ec-442a-afea-1a582c18aef3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:52.558014 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7beb63ac-f5ec-442a-afea-1a582c18aef3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:52.558504 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7beb63ac-f5ec-442a-afea-1a582c18aef3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:52.726642 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-7beb63ac-f5ec-442a-afea-1a582c18aef3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:52.734562 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-7beb63ac-f5ec-442a-afea-1a582c18aef3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25" status: 200 len: 1514 microversion: 2.1 time: 0.190016 Sep 02 17:11:52.746385 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 291/596] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:52 2021] GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25 => generated 1514 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:52.761769 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-4ad222d6-418b-41a7-ba58-0243d641f3d6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:52.762320 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-4ad222d6-418b-41a7-ba58-0243d641f3d6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:52.768734 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4ad222d6-418b-41a7-ba58-0243d641f3d6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:52.769413 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4ad222d6-418b-41a7-ba58-0243d641f3d6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:52.770384 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4ad222d6-418b-41a7-ba58-0243d641f3d6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:52.771044 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4ad222d6-418b-41a7-ba58-0243d641f3d6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:52.942024 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-4ad222d6-418b-41a7-ba58-0243d641f3d6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:52.954271 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-4ad222d6-418b-41a7-ba58-0243d641f3d6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:52.956479 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-4ad222d6-418b-41a7-ba58-0243d641f3d6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:52.966089 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-4ad222d6-418b-41a7-ba58-0243d641f3d6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1738 microversion: 2.20 time: 0.208193 Sep 02 17:11:52.968585 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 292/597] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:11:52 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1738 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:11:52.972768 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-3608b4c9-f279-462f-9667-7da950978857 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:52.974611 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-3608b4c9-f279-462f-9667-7da950978857 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:52.982318 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3608b4c9-f279-462f-9667-7da950978857 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:52.982799 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3608b4c9-f279-462f-9667-7da950978857 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:52.983588 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3608b4c9-f279-462f-9667-7da950978857 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:52.984031 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3608b4c9-f279-462f-9667-7da950978857 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:53.111605 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-3608b4c9-f279-462f-9667-7da950978857 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38165 microversion: 2.1 time: 0.143636 Sep 02 17:11:53.113554 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 293/598] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:11:52 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38165 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:11:53.121630 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-a39ad9cb-0c89-41c7-b4ac-5bba9bc3fbd9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:53.122344 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-a39ad9cb-0c89-41c7-b4ac-5bba9bc3fbd9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:53.131879 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a39ad9cb-0c89-41c7-b4ac-5bba9bc3fbd9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:53.132320 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a39ad9cb-0c89-41c7-b4ac-5bba9bc3fbd9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:53.133430 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a39ad9cb-0c89-41c7-b4ac-5bba9bc3fbd9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:53.134170 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a39ad9cb-0c89-41c7-b4ac-5bba9bc3fbd9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:53.296370 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-a39ad9cb-0c89-41c7-b4ac-5bba9bc3fbd9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:53.305793 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-a39ad9cb-0c89-41c7-b4ac-5bba9bc3fbd9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1568 microversion: 2.1 time: 0.189951 Sep 02 17:11:53.308355 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 294/599] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:53 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1568 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:53.753238 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-4e752582-b428-44f5-a418-d1455deb08e3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:53.753965 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-4e752582-b428-44f5-a418-d1455deb08e3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 824de352-7b8c-4ab6-8e42-1958f7b70c25] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:53.760950 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4e752582-b428-44f5-a418-d1455deb08e3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:53.766191 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4e752582-b428-44f5-a418-d1455deb08e3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:53.767141 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4e752582-b428-44f5-a418-d1455deb08e3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:53.767770 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4e752582-b428-44f5-a418-d1455deb08e3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:53.926941 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-4e752582-b428-44f5-a418-d1455deb08e3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:53.937015 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-4e752582-b428-44f5-a418-d1455deb08e3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25" status: 200 len: 1514 microversion: 2.1 time: 0.187228 Sep 02 17:11:53.947537 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 295/600] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:53 2021] GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25 => generated 1514 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:11:53.989270 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-ddc5be82-ef29-425d-a185-e0ea52744a75 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:53.991143 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-ddc5be82-ef29-425d-a185-e0ea52744a75 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:54.011073 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ddc5be82-ef29-425d-a185-e0ea52744a75 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:54.011073 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ddc5be82-ef29-425d-a185-e0ea52744a75 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:54.011073 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ddc5be82-ef29-425d-a185-e0ea52744a75 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:54.011073 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ddc5be82-ef29-425d-a185-e0ea52744a75 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:54.186866 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-ddc5be82-ef29-425d-a185-e0ea52744a75 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:54.197244 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-ddc5be82-ef29-425d-a185-e0ea52744a75 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:54.198792 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-ddc5be82-ef29-425d-a185-e0ea52744a75 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:54.199970 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-ddc5be82-ef29-425d-a185-e0ea52744a75 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1738 microversion: 2.20 time: 0.218637 Sep 02 17:11:54.212524 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 296/601] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:11:53 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1738 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:11:54.218918 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-23569743-13c3-4e75-b0c6-2fef355b12bd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:54.219910 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-23569743-13c3-4e75-b0c6-2fef355b12bd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:54.233005 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-23569743-13c3-4e75-b0c6-2fef355b12bd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:54.233709 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-23569743-13c3-4e75-b0c6-2fef355b12bd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:54.238645 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-23569743-13c3-4e75-b0c6-2fef355b12bd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:54.238990 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-23569743-13c3-4e75-b0c6-2fef355b12bd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:54.363785 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-23569743-13c3-4e75-b0c6-2fef355b12bd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38165 microversion: 2.1 time: 0.149379 Sep 02 17:11:54.373581 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 297/602] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:11:54 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38165 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:11:54.381924 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-29fb6f59-0d35-4f24-97ed-880280a69291 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:54.383106 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-29fb6f59-0d35-4f24-97ed-880280a69291 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:54.392420 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-29fb6f59-0d35-4f24-97ed-880280a69291 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:54.392795 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-29fb6f59-0d35-4f24-97ed-880280a69291 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:54.393521 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-29fb6f59-0d35-4f24-97ed-880280a69291 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:54.393942 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-29fb6f59-0d35-4f24-97ed-880280a69291 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:54.705434 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-29fb6f59-0d35-4f24-97ed-880280a69291 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:54.719403 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-29fb6f59-0d35-4f24-97ed-880280a69291 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1568 microversion: 2.1 time: 0.342377 Sep 02 17:11:54.719403 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 298/603] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:54 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1568 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:54.953734 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-2e709c1f-f587-438f-8056-e39fda07a864 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:54.954346 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-2e709c1f-f587-438f-8056-e39fda07a864 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 824de352-7b8c-4ab6-8e42-1958f7b70c25] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:54.972578 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2e709c1f-f587-438f-8056-e39fda07a864 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:54.973045 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2e709c1f-f587-438f-8056-e39fda07a864 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:54.974495 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2e709c1f-f587-438f-8056-e39fda07a864 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:54.975046 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2e709c1f-f587-438f-8056-e39fda07a864 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:55.104323 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-2e709c1f-f587-438f-8056-e39fda07a864 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:55.115223 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-2e709c1f-f587-438f-8056-e39fda07a864 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25" status: 200 len: 1472 microversion: 2.1 time: 0.164665 Sep 02 17:11:55.130015 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 299/604] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:54 2021] GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25 => generated 1472 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:11:55.134810 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-e8f2050b-f0d1-4f30-8bcd-41bb79eb4be0 req-44c4a2b4-3b8d-431e-9e4f-ca94cb474311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "824de352-7b8c-4ab6-8e42-1958f7b70c25", "name": "network-vif-deleted", "tag": "952e9d68-5d66-4070-8f0d-f97eda69ecab"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:55.136298 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:11:55.136298 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:11:55.147945 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-e8f2050b-f0d1-4f30-8bcd-41bb79eb4be0 req-44c4a2b4-3b8d-431e-9e4f-ca94cb474311 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:55.148435 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-e8f2050b-f0d1-4f30-8bcd-41bb79eb4be0 req-44c4a2b4-3b8d-431e-9e4f-ca94cb474311 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:55.177837 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-e8f2050b-f0d1-4f30-8bcd-41bb79eb4be0 req-44c4a2b4-3b8d-431e-9e4f-ca94cb474311 service nova] Creating event network-vif-deleted:952e9d68-5d66-4070-8f0d-f97eda69ecab for instance 824de352-7b8c-4ab6-8e42-1958f7b70c25 on hv-cinder-80626 Sep 02 17:11:55.200285 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-e8f2050b-f0d1-4f30-8bcd-41bb79eb4be0 req-44c4a2b4-3b8d-431e-9e4f-ca94cb474311 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068704 Sep 02 17:11:55.206200 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 300/605] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:11:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:11:55.220483 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-ebad6c79-1be6-40eb-ab6d-ede983e8531a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:55.220810 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-ebad6c79-1be6-40eb-ab6d-ede983e8531a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:55.238595 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ebad6c79-1be6-40eb-ab6d-ede983e8531a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:55.239402 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ebad6c79-1be6-40eb-ab6d-ede983e8531a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:55.242301 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ebad6c79-1be6-40eb-ab6d-ede983e8531a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:55.242757 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ebad6c79-1be6-40eb-ab6d-ede983e8531a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:55.535960 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-ebad6c79-1be6-40eb-ab6d-ede983e8531a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:55.548160 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-ebad6c79-1be6-40eb-ab6d-ede983e8531a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:55.549633 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-ebad6c79-1be6-40eb-ab6d-ede983e8531a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:55.550825 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-ebad6c79-1be6-40eb-ab6d-ede983e8531a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1738 microversion: 2.20 time: 0.335155 Sep 02 17:11:55.558017 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 301/606] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:11:55 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1738 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:11:55.566105 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-5622d3d8-b963-4326-b40f-6f2ca1e9e6a7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:55.567105 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-5622d3d8-b963-4326-b40f-6f2ca1e9e6a7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:55.579592 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5622d3d8-b963-4326-b40f-6f2ca1e9e6a7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:55.580174 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5622d3d8-b963-4326-b40f-6f2ca1e9e6a7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:55.581051 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5622d3d8-b963-4326-b40f-6f2ca1e9e6a7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:55.583961 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5622d3d8-b963-4326-b40f-6f2ca1e9e6a7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:55.723868 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-5622d3d8-b963-4326-b40f-6f2ca1e9e6a7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38165 microversion: 2.1 time: 0.163577 Sep 02 17:11:55.724623 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 302/607] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:11:55 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38165 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:11:55.738943 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-cfb5a889-3f8f-41f7-a880-1a24f7496196 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:55.739702 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-cfb5a889-3f8f-41f7-a880-1a24f7496196 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:55.750987 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cfb5a889-3f8f-41f7-a880-1a24f7496196 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:55.751876 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cfb5a889-3f8f-41f7-a880-1a24f7496196 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:55.752830 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cfb5a889-3f8f-41f7-a880-1a24f7496196 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:55.753613 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cfb5a889-3f8f-41f7-a880-1a24f7496196 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:55.932840 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-cfb5a889-3f8f-41f7-a880-1a24f7496196 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:55.944224 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-cfb5a889-3f8f-41f7-a880-1a24f7496196 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1568 microversion: 2.1 time: 0.213224 Sep 02 17:11:55.945397 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 303/608] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:55 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1568 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:56.149786 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-088451fd-32e1-4027-84dd-f8eea2a5ca63 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:56.150534 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-088451fd-32e1-4027-84dd-f8eea2a5ca63 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 824de352-7b8c-4ab6-8e42-1958f7b70c25] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:56.159181 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-088451fd-32e1-4027-84dd-f8eea2a5ca63 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:56.160866 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-088451fd-32e1-4027-84dd-f8eea2a5ca63 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:56.163822 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-088451fd-32e1-4027-84dd-f8eea2a5ca63 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:56.164382 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-088451fd-32e1-4027-84dd-f8eea2a5ca63 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:56.188044 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.wsgi [None req-088451fd-32e1-4027-84dd-f8eea2a5ca63 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] HTTP exception thrown: Instance 824de352-7b8c-4ab6-8e42-1958f7b70c25 could not be found. Sep 02 17:11:56.196657 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-088451fd-32e1-4027-84dd-f8eea2a5ca63 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Returning 404 to user: Instance 824de352-7b8c-4ab6-8e42-1958f7b70c25 could not be found. {{(pid=108418) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:11:56.197948 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-088451fd-32e1-4027-84dd-f8eea2a5ca63 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25" status: 404 len: 111 microversion: 2.1 time: 0.052026 Sep 02 17:11:56.198997 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 304/609] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:56 2021] GET /compute/v2.1/servers/824de352-7b8c-4ab6-8e42-1958f7b70c25 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 17:11:56.207413 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-d8000986-ff9d-4489-8f5e-b8f4e806bb25 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:56.208336 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-d8000986-ff9d-4489-8f5e-b8f4e806bb25 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 63d568ab-141d-4831-94e8-31e3b983dd4a] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:56.215133 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d8000986-ff9d-4489-8f5e-b8f4e806bb25 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:56.215907 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d8000986-ff9d-4489-8f5e-b8f4e806bb25 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:56.216806 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d8000986-ff9d-4489-8f5e-b8f4e806bb25 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:56.217313 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d8000986-ff9d-4489-8f5e-b8f4e806bb25 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:56.257218 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-d8000986-ff9d-4489-8f5e-b8f4e806bb25 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 63d568ab-141d-4831-94e8-31e3b983dd4a] Going to try to terminate instance {{(pid=108418) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 17:11:56.381196 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-d8000986-ff9d-4489-8f5e-b8f4e806bb25 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "DELETE /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a" status: 204 len: 0 microversion: 2.1 time: 0.175140 Sep 02 17:11:56.386082 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 305/610] 10.222.0.41 () {58 vars in 1239 bytes} [Thu Sep 2 17:11:56 2021] DELETE /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 17:11:56.392646 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-b97336e7-b7b1-4521-a771-4a69c3402273 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:56.393890 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-b97336e7-b7b1-4521-a771-4a69c3402273 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 63d568ab-141d-4831-94e8-31e3b983dd4a] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:56.401578 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b97336e7-b7b1-4521-a771-4a69c3402273 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:56.402509 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b97336e7-b7b1-4521-a771-4a69c3402273 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:56.403492 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b97336e7-b7b1-4521-a771-4a69c3402273 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:56.404007 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b97336e7-b7b1-4521-a771-4a69c3402273 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:56.491325 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.network.neutron [None req-b238e696-4ecc-4585-b9ff-dc3010a92995 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] validate_networks() for [('66d8eb5c-183b-4388-baa3-2c614c901226', None, None, None, None, None)] {{(pid=108417) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 17:11:56.618368 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-b97336e7-b7b1-4521-a771-4a69c3402273 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:56.629828 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-b97336e7-b7b1-4521-a771-4a69c3402273 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a" status: 200 len: 1513 microversion: 2.1 time: 0.241860 Sep 02 17:11:56.630799 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 306/611] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:56 2021] GET /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a => generated 1513 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:56.635280 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-89b4035a-02d0-4184-9197-3a5871b5441e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:56.635888 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-89b4035a-02d0-4184-9197-3a5871b5441e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:56.644087 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-89b4035a-02d0-4184-9197-3a5871b5441e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:56.644528 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-89b4035a-02d0-4184-9197-3a5871b5441e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:56.645464 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-89b4035a-02d0-4184-9197-3a5871b5441e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:56.646231 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-89b4035a-02d0-4184-9197-3a5871b5441e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:56.791284 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-89b4035a-02d0-4184-9197-3a5871b5441e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:56.800028 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-89b4035a-02d0-4184-9197-3a5871b5441e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:56.801388 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-89b4035a-02d0-4184-9197-3a5871b5441e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:56.802698 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-89b4035a-02d0-4184-9197-3a5871b5441e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1738 microversion: 2.20 time: 0.171035 Sep 02 17:11:56.811703 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 307/612] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:11:56 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:11:56.811703 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-bde3fd73-1d08-46b1-b489-c5c74f2bde28 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:56.811703 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-bde3fd73-1d08-46b1-b489-c5c74f2bde28 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:56.819734 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bde3fd73-1d08-46b1-b489-c5c74f2bde28 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:56.820411 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bde3fd73-1d08-46b1-b489-c5c74f2bde28 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:56.821563 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bde3fd73-1d08-46b1-b489-c5c74f2bde28 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:56.822159 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bde3fd73-1d08-46b1-b489-c5c74f2bde28 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:56.949465 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-b238e696-4ecc-4585-b9ff-dc3010a92995 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Flavor limits 0:0:0 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 17:11:56.949880 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-b238e696-4ecc-4585-b9ff-dc3010a92995 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Image limits 0:0:0 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 17:11:56.950351 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-b238e696-4ecc-4585-b9ff-dc3010a92995 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Flavor pref 0:0:0 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 17:11:56.950777 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-b238e696-4ecc-4585-b9ff-dc3010a92995 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Image pref 0:0:0 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 17:11:56.951186 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-b238e696-4ecc-4585-b9ff-dc3010a92995 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 17:11:56.970032 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b238e696-4ecc-4585-b9ff-dc3010a92995 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:56.970468 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b238e696-4ecc-4585-b9ff-dc3010a92995 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:56.971292 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b238e696-4ecc-4585-b9ff-dc3010a92995 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:56.971718 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b238e696-4ecc-4585-b9ff-dc3010a92995 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:56.988727 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.quota [None req-b238e696-4ecc-4585-b9ff-dc3010a92995 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Getting quotas for project 8b68171454c54ab49ec2f23eb7573aa8. Resources: {'instances', 'cores', 'ram'} {{(pid=108417) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 17:11:56.992600 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.quota [None req-b238e696-4ecc-4585-b9ff-dc3010a92995 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Getting quotas for user 45335dcd625c4b819d42cacea1aaf946 and project 8b68171454c54ab49ec2f23eb7573aa8. Resources: {'instances', 'cores', 'ram'} {{(pid=108417) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 17:11:57.003032 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-b238e696-4ecc-4585-b9ff-dc3010a92995 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Going to run 1 instances... {{(pid=108417) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 17:11:57.005501 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-b238e696-4ecc-4585-b9ff-dc3010a92995 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 39f237e0-63e9-4871-9dd5-ab033d35ae67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22ce6e29-f3a7-49f0-b93a-ddbffa14e44e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108417) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 17:11:57.068920 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-b238e696-4ecc-4585-b9ff-dc3010a92995 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.785848 Sep 02 17:11:57.070782 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 306/613] 10.222.0.41 () {60 vars in 1147 bytes} [Thu Sep 2 17:11:52 2021] POST /compute/v2.1/servers => generated 380 bytes in 4789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 17:11:57.076025 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-7a88eb06-a43f-4cb1-8c77-3ca9652e5fe9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:57.076639 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-7a88eb06-a43f-4cb1-8c77-3ca9652e5fe9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:57.095124 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7a88eb06-a43f-4cb1-8c77-3ca9652e5fe9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:57.095710 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7a88eb06-a43f-4cb1-8c77-3ca9652e5fe9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:57.096544 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7a88eb06-a43f-4cb1-8c77-3ca9652e5fe9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:57.097098 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7a88eb06-a43f-4cb1-8c77-3ca9652e5fe9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:57.126245 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-bde3fd73-1d08-46b1-b489-c5c74f2bde28 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38165 microversion: 2.1 time: 0.321070 Sep 02 17:11:57.131827 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 308/614] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:11:56 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38165 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:11:57.137116 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-a5d6458c-2dcd-499d-a341-4c3ab4ba85f3 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:57.137819 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-a5d6458c-2dcd-499d-a341-4c3ab4ba85f3 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 39f237e0-63e9-4871-9dd5-ab033d35ae67] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:57.197578 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-a5d6458c-2dcd-499d-a341-4c3ab4ba85f3 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:57.204229 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-a5d6458c-2dcd-499d-a341-4c3ab4ba85f3 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67" status: 200 len: 1218 microversion: 2.1 time: 0.071172 Sep 02 17:11:57.205532 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 309/615] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:57 2021] GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:57.262573 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-7a88eb06-a43f-4cb1-8c77-3ca9652e5fe9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:57.270324 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-7a88eb06-a43f-4cb1-8c77-3ca9652e5fe9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1568 microversion: 2.1 time: 0.198203 Sep 02 17:11:57.271607 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 307/616] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:57 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1568 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:57.649088 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-12eb1d4c-d1fa-495e-b7eb-72883e4ece41 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:57.649759 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-12eb1d4c-d1fa-495e-b7eb-72883e4ece41 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 63d568ab-141d-4831-94e8-31e3b983dd4a] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:57.657692 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-12eb1d4c-d1fa-495e-b7eb-72883e4ece41 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:57.658158 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-12eb1d4c-d1fa-495e-b7eb-72883e4ece41 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:57.659079 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-12eb1d4c-d1fa-495e-b7eb-72883e4ece41 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:57.659498 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-12eb1d4c-d1fa-495e-b7eb-72883e4ece41 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:57.821418 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-cad78602-5ac7-4130-b7e1-1e2fef4687e8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:57.822153 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-cad78602-5ac7-4130-b7e1-1e2fef4687e8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:57.828204 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-cad78602-5ac7-4130-b7e1-1e2fef4687e8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:57.828654 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-cad78602-5ac7-4130-b7e1-1e2fef4687e8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:57.829611 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-cad78602-5ac7-4130-b7e1-1e2fef4687e8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:57.830044 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-cad78602-5ac7-4130-b7e1-1e2fef4687e8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:57.857405 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-12eb1d4c-d1fa-495e-b7eb-72883e4ece41 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:57.866094 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-12eb1d4c-d1fa-495e-b7eb-72883e4ece41 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a" status: 200 len: 1513 microversion: 2.1 time: 0.222308 Sep 02 17:11:57.866894 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 310/617] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:57 2021] GET /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a => generated 1513 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:57.962465 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-cad78602-5ac7-4130-b7e1-1e2fef4687e8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:57.970148 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-cad78602-5ac7-4130-b7e1-1e2fef4687e8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:57.971749 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-cad78602-5ac7-4130-b7e1-1e2fef4687e8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:57.972920 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-cad78602-5ac7-4130-b7e1-1e2fef4687e8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1720 microversion: 2.20 time: 0.155571 Sep 02 17:11:57.973464 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 308/618] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:11:57 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:11:58.140418 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-94d19b05-8dfb-426c-a1cf-65c1f1053752 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:58.141518 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-94d19b05-8dfb-426c-a1cf-65c1f1053752 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:58.149109 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-94d19b05-8dfb-426c-a1cf-65c1f1053752 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:58.149643 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-94d19b05-8dfb-426c-a1cf-65c1f1053752 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:58.150720 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-94d19b05-8dfb-426c-a1cf-65c1f1053752 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:58.151231 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-94d19b05-8dfb-426c-a1cf-65c1f1053752 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:58.221191 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-c7f8a1e5-4f6a-4cc0-9a56-4e0f6105dbfa tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:58.222081 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-c7f8a1e5-4f6a-4cc0-9a56-4e0f6105dbfa tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 39f237e0-63e9-4871-9dd5-ab033d35ae67] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:58.228497 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c7f8a1e5-4f6a-4cc0-9a56-4e0f6105dbfa tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:58.229275 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c7f8a1e5-4f6a-4cc0-9a56-4e0f6105dbfa tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:58.230199 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c7f8a1e5-4f6a-4cc0-9a56-4e0f6105dbfa tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:58.230739 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c7f8a1e5-4f6a-4cc0-9a56-4e0f6105dbfa tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:58.299749 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-94d19b05-8dfb-426c-a1cf-65c1f1053752 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38165 microversion: 2.1 time: 0.163584 Sep 02 17:11:58.306417 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-c7f8a1e5-4f6a-4cc0-9a56-4e0f6105dbfa tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:58.308826 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 311/619] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:11:58 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38165 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:11:58.314847 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-c7f8a1e5-4f6a-4cc0-9a56-4e0f6105dbfa tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67" status: 200 len: 1278 microversion: 2.1 time: 0.097229 Sep 02 17:11:58.315962 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 309/620] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:58 2021] GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67 => generated 1278 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:58.321597 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-184feda9-4c45-45b3-a03a-9cea6f156ae9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:58.325561 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-184feda9-4c45-45b3-a03a-9cea6f156ae9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:58.349246 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-184feda9-4c45-45b3-a03a-9cea6f156ae9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:58.349706 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-184feda9-4c45-45b3-a03a-9cea6f156ae9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:58.350591 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-184feda9-4c45-45b3-a03a-9cea6f156ae9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:58.351099 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-184feda9-4c45-45b3-a03a-9cea6f156ae9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:58.757177 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-184feda9-4c45-45b3-a03a-9cea6f156ae9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:58.765799 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-184feda9-4c45-45b3-a03a-9cea6f156ae9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1568 microversion: 2.1 time: 0.454201 Sep 02 17:11:58.771216 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 312/621] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:58 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1568 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:58.883488 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-44e8451c-90f1-4bba-a9c7-ba28c7382f90 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:58.884310 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-44e8451c-90f1-4bba-a9c7-ba28c7382f90 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 63d568ab-141d-4831-94e8-31e3b983dd4a] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:58.890181 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-44e8451c-90f1-4bba-a9c7-ba28c7382f90 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:58.890738 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-44e8451c-90f1-4bba-a9c7-ba28c7382f90 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:58.891600 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-44e8451c-90f1-4bba-a9c7-ba28c7382f90 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:58.892034 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-44e8451c-90f1-4bba-a9c7-ba28c7382f90 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:58.991218 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-c37136de-daf1-4603-9b38-8cb57a4dcc9c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:58.992111 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-c37136de-daf1-4603-9b38-8cb57a4dcc9c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:59.004823 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c37136de-daf1-4603-9b38-8cb57a4dcc9c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:59.006095 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c37136de-daf1-4603-9b38-8cb57a4dcc9c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:59.006913 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c37136de-daf1-4603-9b38-8cb57a4dcc9c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:59.007353 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c37136de-daf1-4603-9b38-8cb57a4dcc9c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:59.031427 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-44e8451c-90f1-4bba-a9c7-ba28c7382f90 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:59.038895 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-44e8451c-90f1-4bba-a9c7-ba28c7382f90 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a" status: 200 len: 1513 microversion: 2.1 time: 0.159861 Sep 02 17:11:59.039625 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 310/622] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:58 2021] GET /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:59.184063 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-c37136de-daf1-4603-9b38-8cb57a4dcc9c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:59.192209 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-c37136de-daf1-4603-9b38-8cb57a4dcc9c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:59.194322 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-c37136de-daf1-4603-9b38-8cb57a4dcc9c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:59.195556 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-c37136de-daf1-4603-9b38-8cb57a4dcc9c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1720 microversion: 2.20 time: 0.208338 Sep 02 17:11:59.196368 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 313/623] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:11:58 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1720 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:11:59.318887 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-89416eb1-67d9-4f3c-a885-ddeae0c4a5bf tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:59.319873 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-89416eb1-67d9-4f3c-a885-ddeae0c4a5bf tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:59.327108 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-89416eb1-67d9-4f3c-a885-ddeae0c4a5bf tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:59.327565 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-89416eb1-67d9-4f3c-a885-ddeae0c4a5bf tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:59.328563 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-89416eb1-67d9-4f3c-a885-ddeae0c4a5bf tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:59.328980 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-89416eb1-67d9-4f3c-a885-ddeae0c4a5bf tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:59.333477 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-9f4f5f35-2249-4b8e-88b0-fcf46e632bfa tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:59.334088 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-9f4f5f35-2249-4b8e-88b0-fcf46e632bfa tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 39f237e0-63e9-4871-9dd5-ab033d35ae67] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:59.340181 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9f4f5f35-2249-4b8e-88b0-fcf46e632bfa tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:59.340630 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9f4f5f35-2249-4b8e-88b0-fcf46e632bfa tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:59.341411 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9f4f5f35-2249-4b8e-88b0-fcf46e632bfa tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:59.341826 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9f4f5f35-2249-4b8e-88b0-fcf46e632bfa tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:59.429332 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-89416eb1-67d9-4f3c-a885-ddeae0c4a5bf tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38165 microversion: 2.1 time: 0.114036 Sep 02 17:11:59.430195 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 311/624] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:11:59 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38165 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:11:59.541234 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-9f4f5f35-2249-4b8e-88b0-fcf46e632bfa tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:11:59.550590 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-9f4f5f35-2249-4b8e-88b0-fcf46e632bfa tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67" status: 200 len: 1318 microversion: 2.1 time: 0.220460 Sep 02 17:11:59.551767 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 314/625] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:59 2021] GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:11:59.784411 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-b07879c3-e0cd-447d-b243-b81ab9884456 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:11:59.785110 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-b07879c3-e0cd-447d-b243-b81ab9884456 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:11:59.790354 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-09c12bbb-ebd7-473d-904f-06e4567abcfa req-d6466e87-b692-4aa2-a1fe-21046e0c567f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e92c68a-a864-4562-b08b-d244394268ce", "name": "network-vif-unplugged", "status": "completed", "tag": "0a87c875-7882-47c2-a092-e14ea53f2b64"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:11:59.792219 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:11:59.792219 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:11:59.802902 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b07879c3-e0cd-447d-b243-b81ab9884456 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:59.803666 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b07879c3-e0cd-447d-b243-b81ab9884456 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:59.804748 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b07879c3-e0cd-447d-b243-b81ab9884456 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:59.805334 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b07879c3-e0cd-447d-b243-b81ab9884456 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:59.806359 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-09c12bbb-ebd7-473d-904f-06e4567abcfa req-d6466e87-b692-4aa2-a1fe-21046e0c567f service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:11:59.807918 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-09c12bbb-ebd7-473d-904f-06e4567abcfa req-d6466e87-b692-4aa2-a1fe-21046e0c567f service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:11:59.831313 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-09c12bbb-ebd7-473d-904f-06e4567abcfa req-d6466e87-b692-4aa2-a1fe-21046e0c567f service nova] Creating event network-vif-unplugged:0a87c875-7882-47c2-a092-e14ea53f2b64 for instance 4e92c68a-a864-4562-b08b-d244394268ce on hv-cinder-80626 Sep 02 17:11:59.855200 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-09c12bbb-ebd7-473d-904f-06e4567abcfa req-d6466e87-b692-4aa2-a1fe-21046e0c567f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069959 Sep 02 17:11:59.856271 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 315/626] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:11:59 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:12:00.059050 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-83df9de6-caa1-4bb5-b547-847d2d7d1648 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:00.060408 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-83df9de6-caa1-4bb5-b547-847d2d7d1648 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 63d568ab-141d-4831-94e8-31e3b983dd4a] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:00.069264 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-83df9de6-caa1-4bb5-b547-847d2d7d1648 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:00.070308 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-83df9de6-caa1-4bb5-b547-847d2d7d1648 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:00.071303 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-83df9de6-caa1-4bb5-b547-847d2d7d1648 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:00.071903 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-83df9de6-caa1-4bb5-b547-847d2d7d1648 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:00.090320 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-b07879c3-e0cd-447d-b243-b81ab9884456 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:00.103354 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-b07879c3-e0cd-447d-b243-b81ab9884456 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1568 microversion: 2.1 time: 0.323581 Sep 02 17:12:00.114120 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 312/627] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:11:59 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1568 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:00.214283 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-ef7ce23c-8a6e-4357-99e2-94c5886d5af9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:00.215138 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-ef7ce23c-8a6e-4357-99e2-94c5886d5af9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:00.249495 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ef7ce23c-8a6e-4357-99e2-94c5886d5af9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:00.250133 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ef7ce23c-8a6e-4357-99e2-94c5886d5af9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:00.251140 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ef7ce23c-8a6e-4357-99e2-94c5886d5af9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:00.251574 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ef7ce23c-8a6e-4357-99e2-94c5886d5af9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:00.405725 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-83df9de6-caa1-4bb5-b547-847d2d7d1648 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:00.416909 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-83df9de6-caa1-4bb5-b547-847d2d7d1648 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a" status: 200 len: 1513 microversion: 2.1 time: 0.362884 Sep 02 17:12:00.417506 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 316/628] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:00 2021] GET /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a => generated 1513 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:00.432376 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-2ecea2c6-17bb-4b75-893d-05db2b0575b7 req-35d7717f-c372-48e1-87a1-23d2b94a2014 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d568ab-141d-4831-94e8-31e3b983dd4a", "name": "network-vif-deleted", "tag": "3e150f1a-44ff-4964-8378-9720427117af"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:00.434826 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:12:00.434826 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:12:00.448450 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-2ecea2c6-17bb-4b75-893d-05db2b0575b7 req-35d7717f-c372-48e1-87a1-23d2b94a2014 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:00.449180 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-2ecea2c6-17bb-4b75-893d-05db2b0575b7 req-35d7717f-c372-48e1-87a1-23d2b94a2014 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:00.462200 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-2ecea2c6-17bb-4b75-893d-05db2b0575b7 req-35d7717f-c372-48e1-87a1-23d2b94a2014 service nova] Creating event network-vif-deleted:3e150f1a-44ff-4964-8378-9720427117af for instance 63d568ab-141d-4831-94e8-31e3b983dd4a on hv-cinder-80626 Sep 02 17:12:00.469729 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-2ecea2c6-17bb-4b75-893d-05db2b0575b7 req-35d7717f-c372-48e1-87a1-23d2b94a2014 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047817 Sep 02 17:12:00.470551 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 317/629] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:12:00 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:12:00.475878 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-156e0bec-1d18-438a-a11a-8ba6ad470e41 req-fd1beadd-436d-4b1e-afd8-534d9ef5dfcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39f237e0-63e9-4871-9dd5-ab033d35ae67", "tag": "e28d622c-3383-4e88-bb0f-f0ca44fe2164"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:00.477366 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:12:00.477366 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:12:00.484921 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-156e0bec-1d18-438a-a11a-8ba6ad470e41 req-fd1beadd-436d-4b1e-afd8-534d9ef5dfcb service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:00.485454 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-156e0bec-1d18-438a-a11a-8ba6ad470e41 req-fd1beadd-436d-4b1e-afd8-534d9ef5dfcb service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:00.497312 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-156e0bec-1d18-438a-a11a-8ba6ad470e41 req-fd1beadd-436d-4b1e-afd8-534d9ef5dfcb service nova] Creating event network-changed:e28d622c-3383-4e88-bb0f-f0ca44fe2164 for instance 39f237e0-63e9-4871-9dd5-ab033d35ae67 on hv-cinder-80626 Sep 02 17:12:00.502106 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-156e0bec-1d18-438a-a11a-8ba6ad470e41 req-fd1beadd-436d-4b1e-afd8-534d9ef5dfcb service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030203 Sep 02 17:12:00.502729 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 318/630] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:12:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:12:00.508207 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-7dca3b4b-20fd-4703-8b02-3cb90f11278c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:00.509193 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-7dca3b4b-20fd-4703-8b02-3cb90f11278c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:00.515816 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7dca3b4b-20fd-4703-8b02-3cb90f11278c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:00.516254 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7dca3b4b-20fd-4703-8b02-3cb90f11278c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:00.517024 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7dca3b4b-20fd-4703-8b02-3cb90f11278c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:00.517452 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7dca3b4b-20fd-4703-8b02-3cb90f11278c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:00.624704 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-7dca3b4b-20fd-4703-8b02-3cb90f11278c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38165 microversion: 2.1 time: 0.120567 Sep 02 17:12:00.625373 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 319/631] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:12:00 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38165 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:12:00.631037 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-e7398447-3441-4ced-b38b-06d4af0c5f01 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:00.631726 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-e7398447-3441-4ced-b38b-06d4af0c5f01 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 39f237e0-63e9-4871-9dd5-ab033d35ae67] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:00.638539 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e7398447-3441-4ced-b38b-06d4af0c5f01 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:00.639157 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e7398447-3441-4ced-b38b-06d4af0c5f01 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:00.639985 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e7398447-3441-4ced-b38b-06d4af0c5f01 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:00.640474 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e7398447-3441-4ced-b38b-06d4af0c5f01 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:00.769549 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-ef7ce23c-8a6e-4357-99e2-94c5886d5af9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:00.779923 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-ef7ce23c-8a6e-4357-99e2-94c5886d5af9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:00.781729 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-ef7ce23c-8a6e-4357-99e2-94c5886d5af9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:00.783043 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-ef7ce23c-8a6e-4357-99e2-94c5886d5af9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1720 microversion: 2.20 time: 0.572562 Sep 02 17:12:00.784331 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 313/632] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:00 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1720 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:12:00.855324 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-e7398447-3441-4ced-b38b-06d4af0c5f01 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:00.872686 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-e7398447-3441-4ced-b38b-06d4af0c5f01 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67" status: 200 len: 1318 microversion: 2.1 time: 0.246097 Sep 02 17:12:00.873269 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 320/633] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:00 2021] GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67 => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:01.121138 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-1ee29f61-dab6-41a9-8123-80e31cdcc2cb tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:01.121767 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-1ee29f61-dab6-41a9-8123-80e31cdcc2cb tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:01.128431 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1ee29f61-dab6-41a9-8123-80e31cdcc2cb tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:01.128879 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1ee29f61-dab6-41a9-8123-80e31cdcc2cb tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:01.129867 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1ee29f61-dab6-41a9-8123-80e31cdcc2cb tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:01.130334 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1ee29f61-dab6-41a9-8123-80e31cdcc2cb tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:01.264693 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-1ee29f61-dab6-41a9-8123-80e31cdcc2cb tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:01.273939 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-1ee29f61-dab6-41a9-8123-80e31cdcc2cb tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1548 microversion: 2.1 time: 0.156501 Sep 02 17:12:01.275149 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 314/634] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:01 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:01.292713 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-f6b5aaaf-2fd1-4e3d-9473-1f05a6ce3962 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:01.293214 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-f6b5aaaf-2fd1-4e3d-9473-1f05a6ce3962 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:01.300912 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f6b5aaaf-2fd1-4e3d-9473-1f05a6ce3962 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:01.301359 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f6b5aaaf-2fd1-4e3d-9473-1f05a6ce3962 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:01.302159 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f6b5aaaf-2fd1-4e3d-9473-1f05a6ce3962 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:01.302594 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f6b5aaaf-2fd1-4e3d-9473-1f05a6ce3962 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:01.417169 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.wsgi [None req-f6b5aaaf-2fd1-4e3d-9473-1f05a6ce3962 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] HTTP exception thrown: Cannot 'detach_volume' instance 089cf4bd-25a6-4572-a20b-99c71430e5f8 while it is in vm_state rescued Sep 02 17:12:01.418483 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-f6b5aaaf-2fd1-4e3d-9473-1f05a6ce3962 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Returning 409 to user: Cannot 'detach_volume' instance 089cf4bd-25a6-4572-a20b-99c71430e5f8 while it is in vm_state rescued {{(pid=108418) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:12:01.419546 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-f6b5aaaf-2fd1-4e3d-9473-1f05a6ce3962 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "DELETE /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8/os-volume_attachments/68e63001-5935-4387-b378-f71efbca4786" status: 409 len: 152 microversion: 2.1 time: 0.131186 Sep 02 17:12:01.420408 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 321/635] 10.222.0.41 () {58 vars in 1416 bytes} [Thu Sep 2 17:12:01 2021] DELETE /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8/os-volume_attachments/68e63001-5935-4387-b378-f71efbca4786 => generated 152 bytes in 133 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 02 17:12:01.429685 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-839154e0-cfb9-4c75-904d-b787de2d703f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:01.430385 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-839154e0-cfb9-4c75-904d-b787de2d703f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:01.433480 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-7d191c90-e540-4e89-8f8a-600f400a07f5 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:01.434107 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-7d191c90-e540-4e89-8f8a-600f400a07f5 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: 63d568ab-141d-4831-94e8-31e3b983dd4a] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:01.438314 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-839154e0-cfb9-4c75-904d-b787de2d703f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:01.438798 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-839154e0-cfb9-4c75-904d-b787de2d703f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:01.439783 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-839154e0-cfb9-4c75-904d-b787de2d703f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:01.440225 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-839154e0-cfb9-4c75-904d-b787de2d703f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:01.441772 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7d191c90-e540-4e89-8f8a-600f400a07f5 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:01.442228 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7d191c90-e540-4e89-8f8a-600f400a07f5 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:01.443441 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7d191c90-e540-4e89-8f8a-600f400a07f5 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:01.444327 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7d191c90-e540-4e89-8f8a-600f400a07f5 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:01.464400 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.wsgi [None req-7d191c90-e540-4e89-8f8a-600f400a07f5 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] HTTP exception thrown: Instance 63d568ab-141d-4831-94e8-31e3b983dd4a could not be found. Sep 02 17:12:01.464994 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-7d191c90-e540-4e89-8f8a-600f400a07f5 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Returning 404 to user: Instance 63d568ab-141d-4831-94e8-31e3b983dd4a could not be found. {{(pid=108418) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:12:01.465815 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-7d191c90-e540-4e89-8f8a-600f400a07f5 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a" status: 404 len: 111 microversion: 2.1 time: 0.036078 Sep 02 17:12:01.466532 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 322/636] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:01 2021] GET /compute/v2.1/servers/63d568ab-141d-4831-94e8-31e3b983dd4a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 17:12:01.563607 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-839154e0-cfb9-4c75-904d-b787de2d703f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "POST /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8/action" status: 202 len: 0 microversion: 2.1 time: 0.138007 Sep 02 17:12:01.567813 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 315/637] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:12:01 2021] POST /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:12:01.575504 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-aa4296e7-b78e-44ee-98f8-62daed832b61 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:01.576113 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-aa4296e7-b78e-44ee-98f8-62daed832b61 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:01.585121 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-aa4296e7-b78e-44ee-98f8-62daed832b61 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:01.585581 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-aa4296e7-b78e-44ee-98f8-62daed832b61 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:01.586504 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-aa4296e7-b78e-44ee-98f8-62daed832b61 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:01.587119 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-aa4296e7-b78e-44ee-98f8-62daed832b61 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:01.638298 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-6da16767-4d6c-4d7e-918f-4f102495e31c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:01.639594 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-6da16767-4d6c-4d7e-918f-4f102495e31c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:01.649108 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6da16767-4d6c-4d7e-918f-4f102495e31c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:01.650241 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6da16767-4d6c-4d7e-918f-4f102495e31c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:01.651405 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6da16767-4d6c-4d7e-918f-4f102495e31c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:01.652841 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6da16767-4d6c-4d7e-918f-4f102495e31c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:01.780685 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-6da16767-4d6c-4d7e-918f-4f102495e31c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38165 microversion: 2.1 time: 0.146185 Sep 02 17:12:01.785616 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-aa4296e7-b78e-44ee-98f8-62daed832b61 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:01.797799 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 316/638] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:12:01 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38165 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:12:01.807975 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-bb30faaf-0343-479d-b27d-cca9194b3139 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:01.807975 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-bb30faaf-0343-479d-b27d-cca9194b3139 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:01.811669 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-aa4296e7-b78e-44ee-98f8-62daed832b61 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1556 microversion: 2.1 time: 0.239678 Sep 02 17:12:01.812238 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 323/639] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:01 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1556 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:01.822843 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-bb30faaf-0343-479d-b27d-cca9194b3139 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:01.822843 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-bb30faaf-0343-479d-b27d-cca9194b3139 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:01.822843 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-bb30faaf-0343-479d-b27d-cca9194b3139 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:01.822843 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-bb30faaf-0343-479d-b27d-cca9194b3139 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:01.889195 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-5769b77c-ec81-4256-8287-581860f861c9 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:01.889822 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-5769b77c-ec81-4256-8287-581860f861c9 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 39f237e0-63e9-4871-9dd5-ab033d35ae67] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:01.904219 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5769b77c-ec81-4256-8287-581860f861c9 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:01.904842 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5769b77c-ec81-4256-8287-581860f861c9 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:01.905788 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5769b77c-ec81-4256-8287-581860f861c9 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:01.906230 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5769b77c-ec81-4256-8287-581860f861c9 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:02.065098 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-bb30faaf-0343-479d-b27d-cca9194b3139 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:02.076132 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-bb30faaf-0343-479d-b27d-cca9194b3139 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:02.080337 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-bb30faaf-0343-479d-b27d-cca9194b3139 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:02.081842 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-bb30faaf-0343-479d-b27d-cca9194b3139 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1723 microversion: 2.20 time: 0.282938 Sep 02 17:12:02.083123 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 317/640] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:01 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1723 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:12:02.106405 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-4c452211-4d7d-4801-9090-3f8c68d6945a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47747882-9ad2-4c90-9c96-3b72e24e1413"}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:02.107240 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-5769b77c-ec81-4256-8287-581860f861c9 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:02.108546 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-4c452211-4d7d-4801-9090-3f8c68d6945a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:02.115768 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4c452211-4d7d-4801-9090-3f8c68d6945a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:02.116338 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4c452211-4d7d-4801-9090-3f8c68d6945a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:02.117318 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4c452211-4d7d-4801-9090-3f8c68d6945a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:02.117979 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4c452211-4d7d-4801-9090-3f8c68d6945a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:02.126799 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-5769b77c-ec81-4256-8287-581860f861c9 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67" status: 200 len: 1318 microversion: 2.1 time: 0.241384 Sep 02 17:12:02.127589 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 324/641] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:01 2021] GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:02.451917 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-4c452211-4d7d-4801-9090-3f8c68d6945a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.354862 Sep 02 17:12:02.456596 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 318/642] 10.222.0.41 () {62 vars in 1364 bytes} [Thu Sep 2 17:12:02 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/os-volume_attachments => generated 188 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:12:02.574707 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-b66df024-85ac-43c2-9771-37b5b0a2d878 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:02.575274 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-b66df024-85ac-43c2-9771-37b5b0a2d878 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:02.581104 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b66df024-85ac-43c2-9771-37b5b0a2d878 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:02.581545 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b66df024-85ac-43c2-9771-37b5b0a2d878 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:02.582301 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b66df024-85ac-43c2-9771-37b5b0a2d878 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:02.582767 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b66df024-85ac-43c2-9771-37b5b0a2d878 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:02.650525 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-d8884a88-e15a-43d2-a691-52f251436483 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:02.651075 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-d8884a88-e15a-43d2-a691-52f251436483 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:02.659090 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d8884a88-e15a-43d2-a691-52f251436483 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:02.659544 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d8884a88-e15a-43d2-a691-52f251436483 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:02.660323 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d8884a88-e15a-43d2-a691-52f251436483 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:02.660763 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d8884a88-e15a-43d2-a691-52f251436483 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:02.679223 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-b66df024-85ac-43c2-9771-37b5b0a2d878 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action" status: 202 len: 0 microversion: 2.20 time: 0.108029 Sep 02 17:12:02.680171 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 325/643] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:12:02 2021] POST /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 02 17:12:02.687431 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-d8884a88-e15a-43d2-a691-52f251436483 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Going to try to terminate instance {{(pid=108417) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 17:12:02.687623 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-cd69d519-3c68-49a3-b131-4ef9a4ca332d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:02.688332 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-cd69d519-3c68-49a3-b131-4ef9a4ca332d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:02.694789 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cd69d519-3c68-49a3-b131-4ef9a4ca332d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:02.695305 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cd69d519-3c68-49a3-b131-4ef9a4ca332d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:02.696146 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cd69d519-3c68-49a3-b131-4ef9a4ca332d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:02.696642 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cd69d519-3c68-49a3-b131-4ef9a4ca332d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:02.784285 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-d8884a88-e15a-43d2-a691-52f251436483 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "DELETE /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97" status: 204 len: 0 microversion: 2.1 time: 0.137167 Sep 02 17:12:02.785131 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 319/644] 10.222.0.41 () {58 vars in 1239 bytes} [Thu Sep 2 17:12:02 2021] DELETE /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 17:12:02.794139 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-44930ab9-a5a8-4be8-ae53-f45496fe7b10 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:02.794779 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-44930ab9-a5a8-4be8-ae53-f45496fe7b10 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:02.800778 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-44930ab9-a5a8-4be8-ae53-f45496fe7b10 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:02.801225 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-44930ab9-a5a8-4be8-ae53-f45496fe7b10 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:02.802038 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-44930ab9-a5a8-4be8-ae53-f45496fe7b10 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:02.802471 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-44930ab9-a5a8-4be8-ae53-f45496fe7b10 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:02.841543 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-cd69d519-3c68-49a3-b131-4ef9a4ca332d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:02.852953 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-cd69d519-3c68-49a3-b131-4ef9a4ca332d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:02.854429 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-cd69d519-3c68-49a3-b131-4ef9a4ca332d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:02.855677 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-cd69d519-3c68-49a3-b131-4ef9a4ca332d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1749 microversion: 2.20 time: 0.171685 Sep 02 17:12:02.856214 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 326/645] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:02 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1749 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:12:02.861390 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-26ae4e5d-1772-490c-ba1d-8c3909e80c65 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:02.863027 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-26ae4e5d-1772-490c-ba1d-8c3909e80c65 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:02.869756 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-26ae4e5d-1772-490c-ba1d-8c3909e80c65 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:02.870401 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-26ae4e5d-1772-490c-ba1d-8c3909e80c65 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:02.871259 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-26ae4e5d-1772-490c-ba1d-8c3909e80c65 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:02.871690 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-26ae4e5d-1772-490c-ba1d-8c3909e80c65 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:02.942230 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-44930ab9-a5a8-4be8-ae53-f45496fe7b10 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:02.949654 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-44930ab9-a5a8-4be8-ae53-f45496fe7b10 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97" status: 200 len: 1515 microversion: 2.1 time: 0.159595 Sep 02 17:12:02.950323 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 320/646] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:02 2021] GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:02.954573 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-f4cf679e-5926-4b01-81a7-a5c6247566fa tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:02.955200 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-f4cf679e-5926-4b01-81a7-a5c6247566fa tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:02.961202 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f4cf679e-5926-4b01-81a7-a5c6247566fa tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:02.961907 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f4cf679e-5926-4b01-81a7-a5c6247566fa tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:02.962893 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f4cf679e-5926-4b01-81a7-a5c6247566fa tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:02.963331 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f4cf679e-5926-4b01-81a7-a5c6247566fa tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:02.998173 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-26ae4e5d-1772-490c-ba1d-8c3909e80c65 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38294 microversion: 2.1 time: 0.140551 Sep 02 17:12:02.998836 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 327/647] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:12:02 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38294 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:12:03.087334 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-f4cf679e-5926-4b01-81a7-a5c6247566fa tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:03.095348 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-f4cf679e-5926-4b01-81a7-a5c6247566fa tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1556 microversion: 2.1 time: 0.144028 Sep 02 17:12:03.095908 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 321/648] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:02 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1556 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:03.150551 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-644ccca3-e439-49ad-b2b3-8317b32b7b20 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:03.151320 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-644ccca3-e439-49ad-b2b3-8317b32b7b20 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 39f237e0-63e9-4871-9dd5-ab033d35ae67] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:03.157664 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-644ccca3-e439-49ad-b2b3-8317b32b7b20 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:03.158113 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-644ccca3-e439-49ad-b2b3-8317b32b7b20 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:03.158941 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-644ccca3-e439-49ad-b2b3-8317b32b7b20 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:03.159377 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-644ccca3-e439-49ad-b2b3-8317b32b7b20 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:03.292456 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-644ccca3-e439-49ad-b2b3-8317b32b7b20 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:03.300139 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-644ccca3-e439-49ad-b2b3-8317b32b7b20 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67" status: 200 len: 1318 microversion: 2.1 time: 0.154152 Sep 02 17:12:03.300709 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 328/649] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:03 2021] GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:03.874938 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-76d4c7e8-8edd-412e-ac1d-1491910d222b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:03.875535 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-76d4c7e8-8edd-412e-ac1d-1491910d222b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:03.882912 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-76d4c7e8-8edd-412e-ac1d-1491910d222b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:03.883454 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-76d4c7e8-8edd-412e-ac1d-1491910d222b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:03.884309 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-76d4c7e8-8edd-412e-ac1d-1491910d222b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:03.884808 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-76d4c7e8-8edd-412e-ac1d-1491910d222b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:03.966760 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-e4426fd1-9902-4009-a03b-bfa9abc4d025 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:03.967725 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-e4426fd1-9902-4009-a03b-bfa9abc4d025 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:03.974332 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e4426fd1-9902-4009-a03b-bfa9abc4d025 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:03.974925 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e4426fd1-9902-4009-a03b-bfa9abc4d025 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:03.975859 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e4426fd1-9902-4009-a03b-bfa9abc4d025 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:03.976578 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e4426fd1-9902-4009-a03b-bfa9abc4d025 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:04.014991 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-76d4c7e8-8edd-412e-ac1d-1491910d222b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:04.024054 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-76d4c7e8-8edd-412e-ac1d-1491910d222b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:04.031982 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-76d4c7e8-8edd-412e-ac1d-1491910d222b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:04.033578 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-76d4c7e8-8edd-412e-ac1d-1491910d222b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1751 microversion: 2.20 time: 0.162443 Sep 02 17:12:04.034131 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 322/650] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:03 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:12:04.040107 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-c2cadd0b-569b-4d4f-90a5-f774368b1ba3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:04.041084 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-c2cadd0b-569b-4d4f-90a5-f774368b1ba3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:04.047519 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c2cadd0b-569b-4d4f-90a5-f774368b1ba3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:04.048116 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c2cadd0b-569b-4d4f-90a5-f774368b1ba3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:04.049023 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c2cadd0b-569b-4d4f-90a5-f774368b1ba3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:04.049624 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c2cadd0b-569b-4d4f-90a5-f774368b1ba3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:04.123888 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-e4426fd1-9902-4009-a03b-bfa9abc4d025 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:04.131496 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-e4426fd1-9902-4009-a03b-bfa9abc4d025 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97" status: 200 len: 1515 microversion: 2.1 time: 0.168423 Sep 02 17:12:04.132060 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 329/651] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:03 2021] GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:04.136396 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-029d6eca-a2e0-45d3-9543-93160379f8f3 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:04.137000 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-029d6eca-a2e0-45d3-9543-93160379f8f3 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:04.142912 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-029d6eca-a2e0-45d3-9543-93160379f8f3 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:04.143366 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-029d6eca-a2e0-45d3-9543-93160379f8f3 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:04.144130 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-029d6eca-a2e0-45d3-9543-93160379f8f3 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:04.144569 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-029d6eca-a2e0-45d3-9543-93160379f8f3 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:04.272491 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-029d6eca-a2e0-45d3-9543-93160379f8f3 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:04.280216 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-029d6eca-a2e0-45d3-9543-93160379f8f3 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1556 microversion: 2.1 time: 0.147193 Sep 02 17:12:04.280765 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 330/652] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:04 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1556 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:04.316532 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-27bd6766-2356-4830-924b-0d354d8ae028 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:04.317060 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-27bd6766-2356-4830-924b-0d354d8ae028 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 39f237e0-63e9-4871-9dd5-ab033d35ae67] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:04.323007 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-27bd6766-2356-4830-924b-0d354d8ae028 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:04.323452 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-27bd6766-2356-4830-924b-0d354d8ae028 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:04.324202 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-27bd6766-2356-4830-924b-0d354d8ae028 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:04.324632 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-27bd6766-2356-4830-924b-0d354d8ae028 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:04.443974 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-27bd6766-2356-4830-924b-0d354d8ae028 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:04.451836 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-27bd6766-2356-4830-924b-0d354d8ae028 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67" status: 200 len: 1318 microversion: 2.1 time: 0.138951 Sep 02 17:12:04.452392 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 331/653] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:04 2021] GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67 => generated 1318 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:05.053480 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-b63dd469-e315-4124-a5b3-4b4f254f2e67 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:05.054108 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-b63dd469-e315-4124-a5b3-4b4f254f2e67 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:05.060121 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b63dd469-e315-4124-a5b3-4b4f254f2e67 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:05.060555 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b63dd469-e315-4124-a5b3-4b4f254f2e67 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:05.061316 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b63dd469-e315-4124-a5b3-4b4f254f2e67 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:05.061743 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b63dd469-e315-4124-a5b3-4b4f254f2e67 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:05.181780 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-b63dd469-e315-4124-a5b3-4b4f254f2e67 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:05.189996 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-b63dd469-e315-4124-a5b3-4b4f254f2e67 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:05.191535 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-b63dd469-e315-4124-a5b3-4b4f254f2e67 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:05.193327 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-b63dd469-e315-4124-a5b3-4b4f254f2e67 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1751 microversion: 2.20 time: 0.143429 Sep 02 17:12:05.193892 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 332/654] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:05 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1751 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:12:05.198055 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-8d9dc5b0-c51f-487e-95ff-72b79f5b435e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:05.198701 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-8d9dc5b0-c51f-487e-95ff-72b79f5b435e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:05.204137 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8d9dc5b0-c51f-487e-95ff-72b79f5b435e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:05.204585 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8d9dc5b0-c51f-487e-95ff-72b79f5b435e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:05.205347 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8d9dc5b0-c51f-487e-95ff-72b79f5b435e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:05.205783 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8d9dc5b0-c51f-487e-95ff-72b79f5b435e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:05.328929 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-8d9dc5b0-c51f-487e-95ff-72b79f5b435e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:05.336805 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-8d9dc5b0-c51f-487e-95ff-72b79f5b435e tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97" status: 200 len: 1515 microversion: 2.1 time: 0.141940 Sep 02 17:12:05.337363 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 333/655] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:05 2021] GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 => generated 1515 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:05.341729 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-2313aa86-2e8e-4c93-8090-854e00d88459 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:05.342330 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-2313aa86-2e8e-4c93-8090-854e00d88459 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:05.348010 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2313aa86-2e8e-4c93-8090-854e00d88459 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:05.348462 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2313aa86-2e8e-4c93-8090-854e00d88459 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:05.349272 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2313aa86-2e8e-4c93-8090-854e00d88459 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:05.349711 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2313aa86-2e8e-4c93-8090-854e00d88459 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:05.470672 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-2313aa86-2e8e-4c93-8090-854e00d88459 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:05.479170 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-2313aa86-2e8e-4c93-8090-854e00d88459 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1556 microversion: 2.1 time: 0.140859 Sep 02 17:12:05.479726 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 334/656] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:05 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1556 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:05.483908 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-c001932d-9d6e-4578-9007-aba71f5a2768 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:05.484502 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-c001932d-9d6e-4578-9007-aba71f5a2768 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 39f237e0-63e9-4871-9dd5-ab033d35ae67] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:05.490856 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c001932d-9d6e-4578-9007-aba71f5a2768 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:05.491301 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c001932d-9d6e-4578-9007-aba71f5a2768 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:05.492057 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c001932d-9d6e-4578-9007-aba71f5a2768 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:05.492489 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c001932d-9d6e-4578-9007-aba71f5a2768 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:05.615302 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-c001932d-9d6e-4578-9007-aba71f5a2768 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:05.622422 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-c001932d-9d6e-4578-9007-aba71f5a2768 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67" status: 200 len: 1318 microversion: 2.1 time: 0.141757 Sep 02 17:12:05.623024 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 335/657] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:05 2021] GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67 => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:06.211444 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-a21f2dbd-2385-461b-b401-2d57c84d4a43 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:06.212200 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-a21f2dbd-2385-461b-b401-2d57c84d4a43 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:06.218299 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a21f2dbd-2385-461b-b401-2d57c84d4a43 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:06.218785 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a21f2dbd-2385-461b-b401-2d57c84d4a43 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:06.219550 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a21f2dbd-2385-461b-b401-2d57c84d4a43 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:06.219985 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a21f2dbd-2385-461b-b401-2d57c84d4a43 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:06.344605 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-a21f2dbd-2385-461b-b401-2d57c84d4a43 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:06.353691 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-a21f2dbd-2385-461b-b401-2d57c84d4a43 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:06.355282 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-a21f2dbd-2385-461b-b401-2d57c84d4a43 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:06.356428 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-a21f2dbd-2385-461b-b401-2d57c84d4a43 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1751 microversion: 2.20 time: 0.148822 Sep 02 17:12:06.356968 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 336/658] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:06 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1751 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:12:06.361108 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-ce4e37a2-29ff-43d6-aee8-16347fe2607c tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:06.361695 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-ce4e37a2-29ff-43d6-aee8-16347fe2607c tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:06.368396 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ce4e37a2-29ff-43d6-aee8-16347fe2607c tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:06.368841 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ce4e37a2-29ff-43d6-aee8-16347fe2607c tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:06.369602 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ce4e37a2-29ff-43d6-aee8-16347fe2607c tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:06.370027 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ce4e37a2-29ff-43d6-aee8-16347fe2607c tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:06.491117 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-ce4e37a2-29ff-43d6-aee8-16347fe2607c tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:06.498513 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-ce4e37a2-29ff-43d6-aee8-16347fe2607c tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97" status: 200 len: 1515 microversion: 2.1 time: 0.140603 Sep 02 17:12:06.499172 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 337/659] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:06 2021] GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 => generated 1515 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:06.503378 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-a99431fd-a2ab-4c55-894a-e6fefc19eae8 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:06.503979 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-a99431fd-a2ab-4c55-894a-e6fefc19eae8 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:06.509463 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a99431fd-a2ab-4c55-894a-e6fefc19eae8 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:06.509947 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a99431fd-a2ab-4c55-894a-e6fefc19eae8 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:06.510733 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a99431fd-a2ab-4c55-894a-e6fefc19eae8 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:06.511170 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a99431fd-a2ab-4c55-894a-e6fefc19eae8 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:06.633124 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-a99431fd-a2ab-4c55-894a-e6fefc19eae8 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:06.640823 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-a99431fd-a2ab-4c55-894a-e6fefc19eae8 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1556 microversion: 2.1 time: 0.140685 Sep 02 17:12:06.641369 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 338/660] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:06 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1556 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:06.646041 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-baef8e39-1644-473a-b3f5-9133d7481998 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:06.646901 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-baef8e39-1644-473a-b3f5-9133d7481998 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 39f237e0-63e9-4871-9dd5-ab033d35ae67] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:06.652648 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-baef8e39-1644-473a-b3f5-9133d7481998 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:06.653083 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-baef8e39-1644-473a-b3f5-9133d7481998 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:06.653828 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-baef8e39-1644-473a-b3f5-9133d7481998 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:06.654248 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-baef8e39-1644-473a-b3f5-9133d7481998 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:06.775887 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-baef8e39-1644-473a-b3f5-9133d7481998 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:06.783262 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-baef8e39-1644-473a-b3f5-9133d7481998 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67" status: 200 len: 1318 microversion: 2.1 time: 0.140970 Sep 02 17:12:06.784071 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 339/661] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:06 2021] GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67 => generated 1318 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:07.375175 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-f05e595c-b2f2-4e1a-bb45-53b17a0c4666 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:07.375830 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-f05e595c-b2f2-4e1a-bb45-53b17a0c4666 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:07.381915 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f05e595c-b2f2-4e1a-bb45-53b17a0c4666 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:07.382364 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f05e595c-b2f2-4e1a-bb45-53b17a0c4666 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:07.383173 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f05e595c-b2f2-4e1a-bb45-53b17a0c4666 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:07.383605 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f05e595c-b2f2-4e1a-bb45-53b17a0c4666 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:07.432696 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-c2cadd0b-569b-4d4f-90a5-f774368b1ba3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38296 microversion: 2.1 time: 3.396556 Sep 02 17:12:07.433403 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 323/662] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:12:04 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38296 bytes in 3398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:12:07.514239 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-f05e595c-b2f2-4e1a-bb45-53b17a0c4666 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:07.517863 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-9b523cbe-e453-4f28-ada8-1f3f40cf742a tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:07.518759 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-9b523cbe-e453-4f28-ada8-1f3f40cf742a tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:07.523561 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-f05e595c-b2f2-4e1a-bb45-53b17a0c4666 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:07.525139 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-f05e595c-b2f2-4e1a-bb45-53b17a0c4666 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:07.526075 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9b523cbe-e453-4f28-ada8-1f3f40cf742a tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:07.526300 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-f05e595c-b2f2-4e1a-bb45-53b17a0c4666 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1751 microversion: 2.20 time: 0.154825 Sep 02 17:12:07.526517 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9b523cbe-e453-4f28-ada8-1f3f40cf742a tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:07.526883 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 340/663] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:07 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:12:07.527343 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9b523cbe-e453-4f28-ada8-1f3f40cf742a tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:07.527769 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9b523cbe-e453-4f28-ada8-1f3f40cf742a tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:07.652428 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-9b523cbe-e453-4f28-ada8-1f3f40cf742a tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:07.657937 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-fcd2db8e-fc47-4ff0-bba6-99a4591c5378 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:07.658540 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-fcd2db8e-fc47-4ff0-bba6-99a4591c5378 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:07.659960 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-9b523cbe-e453-4f28-ada8-1f3f40cf742a tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97" status: 200 len: 1515 microversion: 2.1 time: 0.148223 Sep 02 17:12:07.660521 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 324/664] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:07 2021] GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 => generated 1515 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:07.664406 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fcd2db8e-fc47-4ff0-bba6-99a4591c5378 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:07.664894 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fcd2db8e-fc47-4ff0-bba6-99a4591c5378 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:07.665673 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fcd2db8e-fc47-4ff0-bba6-99a4591c5378 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:07.666102 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fcd2db8e-fc47-4ff0-bba6-99a4591c5378 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:07.784952 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-fcd2db8e-fc47-4ff0-bba6-99a4591c5378 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:07.792646 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-fcd2db8e-fc47-4ff0-bba6-99a4591c5378 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1556 microversion: 2.1 time: 0.138318 Sep 02 17:12:07.793203 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 341/665] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:07 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1556 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:07.800141 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-111e97aa-e3c6-4e14-8cf5-e696eaef5a86 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:07.800890 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-111e97aa-e3c6-4e14-8cf5-e696eaef5a86 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 39f237e0-63e9-4871-9dd5-ab033d35ae67] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:07.806787 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-111e97aa-e3c6-4e14-8cf5-e696eaef5a86 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:07.807222 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-111e97aa-e3c6-4e14-8cf5-e696eaef5a86 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:07.807968 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-111e97aa-e3c6-4e14-8cf5-e696eaef5a86 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:07.808390 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-111e97aa-e3c6-4e14-8cf5-e696eaef5a86 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:07.928804 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-111e97aa-e3c6-4e14-8cf5-e696eaef5a86 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:07.936226 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-111e97aa-e3c6-4e14-8cf5-e696eaef5a86 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67" status: 200 len: 1318 microversion: 2.1 time: 0.139470 Sep 02 17:12:07.936776 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 325/666] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:07 2021] GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67 => generated 1318 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:08.444625 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-4f783dc4-f2a5-4872-a740-f5ab49791223 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:08.445631 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-4f783dc4-f2a5-4872-a740-f5ab49791223 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:08.452514 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4f783dc4-f2a5-4872-a740-f5ab49791223 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:08.452958 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4f783dc4-f2a5-4872-a740-f5ab49791223 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:08.453730 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4f783dc4-f2a5-4872-a740-f5ab49791223 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:08.454164 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4f783dc4-f2a5-4872-a740-f5ab49791223 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:08.545206 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-3bc81015-ebb7-4775-87ce-fbbabca5f59a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:08.545842 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-3bc81015-ebb7-4775-87ce-fbbabca5f59a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:08.553661 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3bc81015-ebb7-4775-87ce-fbbabca5f59a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:08.554114 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3bc81015-ebb7-4775-87ce-fbbabca5f59a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:08.554923 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3bc81015-ebb7-4775-87ce-fbbabca5f59a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:08.555454 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3bc81015-ebb7-4775-87ce-fbbabca5f59a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:08.594446 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-4f783dc4-f2a5-4872-a740-f5ab49791223 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38296 microversion: 2.1 time: 0.153313 Sep 02 17:12:08.598851 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 342/667] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:12:08 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38296 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:12:08.677145 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-ef9c8a88-e5fd-4762-be5a-7344c1157b23 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:08.678263 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-ef9c8a88-e5fd-4762-be5a-7344c1157b23 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:08.685077 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ef9c8a88-e5fd-4762-be5a-7344c1157b23 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:08.686436 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ef9c8a88-e5fd-4762-be5a-7344c1157b23 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:08.687425 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ef9c8a88-e5fd-4762-be5a-7344c1157b23 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:08.688142 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ef9c8a88-e5fd-4762-be5a-7344c1157b23 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:08.691817 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-3bc81015-ebb7-4775-87ce-fbbabca5f59a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:08.703169 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-3bc81015-ebb7-4775-87ce-fbbabca5f59a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:08.705006 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-3bc81015-ebb7-4775-87ce-fbbabca5f59a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:08.706657 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-3bc81015-ebb7-4775-87ce-fbbabca5f59a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1751 microversion: 2.20 time: 0.165334 Sep 02 17:12:08.707572 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 326/668] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:08 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:12:08.809859 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-f2e91370-a7be-40d7-bcc2-470abdadbe21 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:08.810465 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-f2e91370-a7be-40d7-bcc2-470abdadbe21 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:08.816413 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f2e91370-a7be-40d7-bcc2-470abdadbe21 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:08.816861 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f2e91370-a7be-40d7-bcc2-470abdadbe21 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:08.818198 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f2e91370-a7be-40d7-bcc2-470abdadbe21 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:08.818652 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f2e91370-a7be-40d7-bcc2-470abdadbe21 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:08.836071 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-ef9c8a88-e5fd-4762-be5a-7344c1157b23 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:08.843370 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-ef9c8a88-e5fd-4762-be5a-7344c1157b23 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97" status: 200 len: 1515 microversion: 2.1 time: 0.170727 Sep 02 17:12:08.843977 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 343/669] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:08 2021] GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 => generated 1515 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:08.953323 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-9a1bcc59-ffb2-44c0-a61d-61ea72d81f62 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:08.953996 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-9a1bcc59-ffb2-44c0-a61d-61ea72d81f62 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 39f237e0-63e9-4871-9dd5-ab033d35ae67] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:08.960162 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9a1bcc59-ffb2-44c0-a61d-61ea72d81f62 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:08.960608 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9a1bcc59-ffb2-44c0-a61d-61ea72d81f62 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:08.961391 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9a1bcc59-ffb2-44c0-a61d-61ea72d81f62 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:08.962273 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9a1bcc59-ffb2-44c0-a61d-61ea72d81f62 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:08.982607 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-f2e91370-a7be-40d7-bcc2-470abdadbe21 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:08.996533 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-f2e91370-a7be-40d7-bcc2-470abdadbe21 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1562 microversion: 2.1 time: 0.190671 Sep 02 17:12:08.997403 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 327/670] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:08 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1562 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:09.097195 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-333ab35a-18e4-4afe-b088-1e42bccdc3c9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:09.097910 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-333ab35a-18e4-4afe-b088-1e42bccdc3c9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:09.105466 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-333ab35a-18e4-4afe-b088-1e42bccdc3c9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:09.106013 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-333ab35a-18e4-4afe-b088-1e42bccdc3c9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:09.106875 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-333ab35a-18e4-4afe-b088-1e42bccdc3c9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:09.107437 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-333ab35a-18e4-4afe-b088-1e42bccdc3c9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:09.120104 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-9a1bcc59-ffb2-44c0-a61d-61ea72d81f62 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:09.127586 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-9a1bcc59-ffb2-44c0-a61d-61ea72d81f62 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67" status: 200 len: 1318 microversion: 2.1 time: 0.178063 Sep 02 17:12:09.128156 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 344/671] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:08 2021] GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:09.198440 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.objects.instance [None req-333ab35a-18e4-4afe-b088-1e42bccdc3c9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lazy-loading 'services' on Instance uuid 089cf4bd-25a6-4572-a20b-99c71430e5f8 {{(pid=108417) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 17:12:09.266635 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-333ab35a-18e4-4afe-b088-1e42bccdc3c9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "DELETE /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8/os-volume_attachments/68e63001-5935-4387-b378-f71efbca4786" status: 202 len: 0 microversion: 2.1 time: 0.174806 Sep 02 17:12:09.267214 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 328/672] 10.222.0.41 () {58 vars in 1416 bytes} [Thu Sep 2 17:12:09 2021] DELETE /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8/os-volume_attachments/68e63001-5935-4387-b378-f71efbca4786 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:12:09.275606 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-e29fc474-5f98-47fb-9164-313af30a8c18 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:09.276697 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-e29fc474-5f98-47fb-9164-313af30a8c18 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:09.282200 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e29fc474-5f98-47fb-9164-313af30a8c18 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:09.282889 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e29fc474-5f98-47fb-9164-313af30a8c18 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:09.283534 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e29fc474-5f98-47fb-9164-313af30a8c18 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:09.283975 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e29fc474-5f98-47fb-9164-313af30a8c18 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:09.316166 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-e29fc474-5f98-47fb-9164-313af30a8c18 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044424 Sep 02 17:12:09.316728 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 345/673] 10.222.0.41 () {58 vars in 1302 bytes} [Thu Sep 2 17:12:09 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:12:09.470035 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [req-d225c912-477c-4abc-8b32-0f470c0dc6b6 req-fe0a0ecf-a049-4191-9bfe-e9a973e3a739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc38d921-f6d4-4f6c-89c1-08e1c2d96c97", "name": "network-vif-deleted", "tag": "7e2fc8cd-4943-4413-bed6-883f6ed096b2"}]} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:09.471656 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:12:09.471656 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: warnings.warn(msg) Sep 02 17:12:09.481600 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-d225c912-477c-4abc-8b32-0f470c0dc6b6 req-fe0a0ecf-a049-4191-9bfe-e9a973e3a739 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:09.482335 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-d225c912-477c-4abc-8b32-0f470c0dc6b6 req-fe0a0ecf-a049-4191-9bfe-e9a973e3a739 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:09.500129 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.compute.server_external_events [req-d225c912-477c-4abc-8b32-0f470c0dc6b6 req-fe0a0ecf-a049-4191-9bfe-e9a973e3a739 service nova] Creating event network-vif-deleted:7e2fc8cd-4943-4413-bed6-883f6ed096b2 for instance fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 on hv-cinder-80626 Sep 02 17:12:09.505643 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [req-d225c912-477c-4abc-8b32-0f470c0dc6b6 req-fe0a0ecf-a049-4191-9bfe-e9a973e3a739 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039475 Sep 02 17:12:09.506277 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 329/674] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:12:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:12:09.607939 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-2cdb61ae-dfde-4751-a22b-319558a6cc0b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:09.610172 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-2cdb61ae-dfde-4751-a22b-319558a6cc0b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:09.617754 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2cdb61ae-dfde-4751-a22b-319558a6cc0b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:09.618573 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2cdb61ae-dfde-4751-a22b-319558a6cc0b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:09.620145 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2cdb61ae-dfde-4751-a22b-319558a6cc0b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:09.620818 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2cdb61ae-dfde-4751-a22b-319558a6cc0b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:09.660358 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [req-3873ceee-77d3-468c-9f6e-406f3783a95d req-6cac1519-6f70-4e09-85b0-af5ab73560ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39f237e0-63e9-4871-9dd5-ab033d35ae67", "name": "network-vif-plugged", "status": "completed", "tag": "e28d622c-3383-4e88-bb0f-f0ca44fe2164"}]} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:09.663097 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:12:09.663097 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: warnings.warn(msg) Sep 02 17:12:09.670815 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-3873ceee-77d3-468c-9f6e-406f3783a95d req-6cac1519-6f70-4e09-85b0-af5ab73560ff service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:09.671693 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-3873ceee-77d3-468c-9f6e-406f3783a95d req-6cac1519-6f70-4e09-85b0-af5ab73560ff service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:09.685175 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.compute.server_external_events [req-3873ceee-77d3-468c-9f6e-406f3783a95d req-6cac1519-6f70-4e09-85b0-af5ab73560ff service nova] Creating event network-vif-plugged:e28d622c-3383-4e88-bb0f-f0ca44fe2164 for instance 39f237e0-63e9-4871-9dd5-ab033d35ae67 on hv-cinder-80626 Sep 02 17:12:09.690398 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [req-3873ceee-77d3-468c-9f6e-406f3783a95d req-6cac1519-6f70-4e09-85b0-af5ab73560ff service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034004 Sep 02 17:12:09.691197 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 330/675] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:12:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:12:09.727183 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-16bc684c-a454-4e85-8bbd-a8e354de8420 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:09.728071 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-16bc684c-a454-4e85-8bbd-a8e354de8420 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:09.735620 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-16bc684c-a454-4e85-8bbd-a8e354de8420 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:09.736329 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-16bc684c-a454-4e85-8bbd-a8e354de8420 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:09.737527 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-16bc684c-a454-4e85-8bbd-a8e354de8420 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:09.738115 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-16bc684c-a454-4e85-8bbd-a8e354de8420 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:09.767251 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-2cdb61ae-dfde-4751-a22b-319558a6cc0b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 38798 microversion: 2.1 time: 0.163865 Sep 02 17:12:09.772956 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 346/676] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:12:09 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 38798 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:12:09.789734 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-35792330-150d-4248-abde-52ca6ab1c4aa tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2057564841", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1934407481", "security_groups": [{"name": "tempest-secgroup-smoke-1772581189"}], "block_device_mapping_v2": [{"uuid": "3ad1903e-3c01-4285-bf7e-676469694fc1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ade5891d-380a-4e81-9169-bebc402fc3c9"}]}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:09.943336 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.network.neutron [None req-35792330-150d-4248-abde-52ca6ab1c4aa tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] validate_networks() for [('ade5891d-380a-4e81-9169-bebc402fc3c9', None, None, None, None, None)] {{(pid=108418) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 17:12:09.963216 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-16bc684c-a454-4e85-8bbd-a8e354de8420 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:09.974523 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-16bc684c-a454-4e85-8bbd-a8e354de8420 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:09.976255 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-16bc684c-a454-4e85-8bbd-a8e354de8420 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:09.977732 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-16bc684c-a454-4e85-8bbd-a8e354de8420 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1807 microversion: 2.20 time: 0.256263 Sep 02 17:12:09.978533 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 331/677] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:09 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1807 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:12:09.983801 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-3484b17d-83d1-420f-a6fa-4d5fe960cd9f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:09.984574 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-3484b17d-83d1-420f-a6fa-4d5fe960cd9f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:09.990938 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3484b17d-83d1-420f-a6fa-4d5fe960cd9f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:09.991789 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3484b17d-83d1-420f-a6fa-4d5fe960cd9f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:09.994548 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3484b17d-83d1-420f-a6fa-4d5fe960cd9f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:09.995227 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3484b17d-83d1-420f-a6fa-4d5fe960cd9f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:10.036426 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3484b17d-83d1-420f-a6fa-4d5fe960cd9f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:10.036761 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3484b17d-83d1-420f-a6fa-4d5fe960cd9f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:10.037197 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.objects.instance [None req-3484b17d-83d1-420f-a6fa-4d5fe960cd9f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lazy-loading 'fault' on Instance uuid fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 {{(pid=108417) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 17:12:10.084135 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-3484b17d-83d1-420f-a6fa-4d5fe960cd9f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86d5b6fd03e140b3bfbfef7a087063ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ec1c77ded4a41158a99f6cf578e395e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:10.096071 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-3484b17d-83d1-420f-a6fa-4d5fe960cd9f tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97" status: 200 len: 1308 microversion: 2.1 time: 0.115995 Sep 02 17:12:10.097143 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 332/678] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:09 2021] GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 => generated 1308 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:10.144811 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-093c6431-1eb0-4039-89ea-e1b14e79bc92 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:10.146793 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-093c6431-1eb0-4039-89ea-e1b14e79bc92 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 39f237e0-63e9-4871-9dd5-ab033d35ae67] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:10.155778 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-093c6431-1eb0-4039-89ea-e1b14e79bc92 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:10.156441 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-093c6431-1eb0-4039-89ea-e1b14e79bc92 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:10.158739 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-093c6431-1eb0-4039-89ea-e1b14e79bc92 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:10.159681 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-093c6431-1eb0-4039-89ea-e1b14e79bc92 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:10.313566 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-093c6431-1eb0-4039-89ea-e1b14e79bc92 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:10.326147 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-093c6431-1eb0-4039-89ea-e1b14e79bc92 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67" status: 200 len: 1318 microversion: 2.1 time: 0.184857 Sep 02 17:12:10.335613 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 333/679] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:10 2021] GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:10.340503 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-885ae4f6-0431-4362-9531-cfa8d7e8d7fe tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:10.342909 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-885ae4f6-0431-4362-9531-cfa8d7e8d7fe tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:10.347508 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-885ae4f6-0431-4362-9531-cfa8d7e8d7fe tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:10.347942 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-885ae4f6-0431-4362-9531-cfa8d7e8d7fe tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:10.348710 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-885ae4f6-0431-4362-9531-cfa8d7e8d7fe tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:10.349186 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-885ae4f6-0431-4362-9531-cfa8d7e8d7fe tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:10.382101 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-885ae4f6-0431-4362-9531-cfa8d7e8d7fe tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045309 Sep 02 17:12:10.383058 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 334/680] 10.222.0.41 () {58 vars in 1302 bytes} [Thu Sep 2 17:12:10 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:12:10.417299 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-35792330-150d-4248-abde-52ca6ab1c4aa tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Flavor limits 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 17:12:10.417720 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-35792330-150d-4248-abde-52ca6ab1c4aa tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Image limits 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 17:12:10.418195 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-35792330-150d-4248-abde-52ca6ab1c4aa tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Flavor pref 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 17:12:10.418603 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-35792330-150d-4248-abde-52ca6ab1c4aa tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Image pref 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 17:12:10.419053 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-35792330-150d-4248-abde-52ca6ab1c4aa tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 17:12:10.428381 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-35792330-150d-4248-abde-52ca6ab1c4aa tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:10.428825 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-35792330-150d-4248-abde-52ca6ab1c4aa tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:10.429629 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-35792330-150d-4248-abde-52ca6ab1c4aa tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:10.430064 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-35792330-150d-4248-abde-52ca6ab1c4aa tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:10.448262 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.quota [None req-35792330-150d-4248-abde-52ca6ab1c4aa tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Getting quotas for project dc090408372e41379709e2067823b1a6. Resources: {'instances', 'cores', 'ram'} {{(pid=108418) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 17:12:10.452275 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.quota [None req-35792330-150d-4248-abde-52ca6ab1c4aa tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Getting quotas for user 6df6e202f8b64bb0b33226402b65adaf and project dc090408372e41379709e2067823b1a6. Resources: {'instances', 'cores', 'ram'} {{(pid=108418) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 17:12:10.516636 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-35792330-150d-4248-abde-52ca6ab1c4aa tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Going to run 1 instances... {{(pid=108418) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 17:12:10.518923 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-35792330-150d-4248-abde-52ca6ab1c4aa tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3ad1903e-3c01-4285-bf7e-676469694fc1',volume_size=None,volume_type=None)] {{(pid=108418) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 17:12:10.653161 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-35792330-150d-4248-abde-52ca6ab1c4aa tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.878586 Sep 02 17:12:10.654566 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 347/681] 10.222.0.41 () {60 vars in 1147 bytes} [Thu Sep 2 17:12:09 2021] POST /compute/v2.1/servers => generated 406 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 17:12:10.664687 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-b494e53c-cddc-4ac3-9e9d-da397ab239c7 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:10.665292 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-b494e53c-cddc-4ac3-9e9d-da397ab239c7 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:10.731968 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-b494e53c-cddc-4ac3-9e9d-da397ab239c7 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:10.746168 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-b494e53c-cddc-4ac3-9e9d-da397ab239c7 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1095 microversion: 2.1 time: 0.085537 Sep 02 17:12:10.746939 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 335/682] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:10 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1095 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:10.779522 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-37ff1585-99b9-4a87-b5f9-e4bcbbd6ff83 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:10.780613 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-37ff1585-99b9-4a87-b5f9-e4bcbbd6ff83 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:10.787753 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-37ff1585-99b9-4a87-b5f9-e4bcbbd6ff83 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:10.788323 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-37ff1585-99b9-4a87-b5f9-e4bcbbd6ff83 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:10.789269 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-37ff1585-99b9-4a87-b5f9-e4bcbbd6ff83 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:10.789805 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-37ff1585-99b9-4a87-b5f9-e4bcbbd6ff83 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:10.910099 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-37ff1585-99b9-4a87-b5f9-e4bcbbd6ff83 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41160 microversion: 2.1 time: 0.134272 Sep 02 17:12:10.910713 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 348/683] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:12:10 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41160 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:12:10.996663 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-d58904e0-47f3-47f3-b705-d185de2f111f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:10.998036 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-d58904e0-47f3-47f3-b705-d185de2f111f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:11.003951 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d58904e0-47f3-47f3-b705-d185de2f111f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:11.004636 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d58904e0-47f3-47f3-b705-d185de2f111f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:11.005722 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d58904e0-47f3-47f3-b705-d185de2f111f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:11.006357 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d58904e0-47f3-47f3-b705-d185de2f111f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:11.113912 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-21a69014-71fd-406f-b597-63a4926aaff3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:11.115812 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-21a69014-71fd-406f-b597-63a4926aaff3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] [instance: fc38d921-f6d4-4f6c-89c1-08e1c2d96c97] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:11.135252 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-21a69014-71fd-406f-b597-63a4926aaff3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:11.139468 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-21a69014-71fd-406f-b597-63a4926aaff3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:11.140604 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-21a69014-71fd-406f-b597-63a4926aaff3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:11.141254 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-21a69014-71fd-406f-b597-63a4926aaff3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:11.148140 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-d58904e0-47f3-47f3-b705-d185de2f111f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:11.162427 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-d58904e0-47f3-47f3-b705-d185de2f111f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:11.164949 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-d58904e0-47f3-47f3-b705-d185de2f111f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:11.166418 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-d58904e0-47f3-47f3-b705-d185de2f111f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1807 microversion: 2.20 time: 0.173868 Sep 02 17:12:11.167579 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 336/684] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:10 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:12:11.184464 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.wsgi [None req-21a69014-71fd-406f-b597-63a4926aaff3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] HTTP exception thrown: Instance fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 could not be found. Sep 02 17:12:11.185413 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-21a69014-71fd-406f-b597-63a4926aaff3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] Returning 404 to user: Instance fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 could not be found. {{(pid=108418) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:12:11.186451 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-21a69014-71fd-406f-b597-63a4926aaff3 tempest-AttachVolumeNegativeTest-679200292 tempest-AttachVolumeNegativeTest-679200292-project] 10.222.0.41 "GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97" status: 404 len: 111 microversion: 2.1 time: 0.076849 Sep 02 17:12:11.190735 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 349/685] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:11 2021] GET /compute/v2.1/servers/fc38d921-f6d4-4f6c-89c1-08e1c2d96c97 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 17:12:11.344112 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-1e8b296f-3f8d-4878-bcad-fd45c838904a tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:11.344647 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-1e8b296f-3f8d-4878-bcad-fd45c838904a tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 39f237e0-63e9-4871-9dd5-ab033d35ae67] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:11.362591 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1e8b296f-3f8d-4878-bcad-fd45c838904a tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:11.363332 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1e8b296f-3f8d-4878-bcad-fd45c838904a tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:11.364376 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1e8b296f-3f8d-4878-bcad-fd45c838904a tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:11.365041 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1e8b296f-3f8d-4878-bcad-fd45c838904a tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:11.395113 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-1d074356-2361-4015-8767-35d1691f5235 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:11.397422 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-1d074356-2361-4015-8767-35d1691f5235 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:11.407427 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1d074356-2361-4015-8767-35d1691f5235 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:11.410807 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1d074356-2361-4015-8767-35d1691f5235 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:11.414659 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1d074356-2361-4015-8767-35d1691f5235 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:11.415361 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1d074356-2361-4015-8767-35d1691f5235 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:11.481896 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-1d074356-2361-4015-8767-35d1691f5235 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092319 Sep 02 17:12:11.493132 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 350/686] 10.222.0.41 () {58 vars in 1302 bytes} [Thu Sep 2 17:12:11 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8/os-volume_attachments => generated 25 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 17:12:11.740791 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-1e8b296f-3f8d-4878-bcad-fd45c838904a tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:11.752506 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-1e8b296f-3f8d-4878-bcad-fd45c838904a tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67" status: 200 len: 1318 microversion: 2.1 time: 0.411851 Sep 02 17:12:11.765053 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 337/687] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:11 2021] GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67 => generated 1318 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:11.774715 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-4bfd6260-cf4f-448e-a4ab-f31d1ff85866 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:11.776122 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-4bfd6260-cf4f-448e-a4ab-f31d1ff85866 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:11.793905 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4bfd6260-cf4f-448e-a4ab-f31d1ff85866 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:11.795511 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4bfd6260-cf4f-448e-a4ab-f31d1ff85866 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:11.799369 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4bfd6260-cf4f-448e-a4ab-f31d1ff85866 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:11.800145 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4bfd6260-cf4f-448e-a4ab-f31d1ff85866 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:11.899989 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-4bfd6260-cf4f-448e-a4ab-f31d1ff85866 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:11.911337 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-4bfd6260-cf4f-448e-a4ab-f31d1ff85866 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1137 microversion: 2.1 time: 0.144238 Sep 02 17:12:11.911913 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 351/688] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:11 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1137 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:11.922089 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-fae988c2-7bee-4e96-aa79-722929a9fefd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:11.923436 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-fae988c2-7bee-4e96-aa79-722929a9fefd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:11.932612 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fae988c2-7bee-4e96-aa79-722929a9fefd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:11.933251 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fae988c2-7bee-4e96-aa79-722929a9fefd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:11.934166 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fae988c2-7bee-4e96-aa79-722929a9fefd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:11.934814 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fae988c2-7bee-4e96-aa79-722929a9fefd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:12.184451 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-d1b6e213-bbc5-4aa9-8579-68585d8a7743 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:12.185059 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-d1b6e213-bbc5-4aa9-8579-68585d8a7743 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:12.191682 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d1b6e213-bbc5-4aa9-8579-68585d8a7743 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:12.192127 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d1b6e213-bbc5-4aa9-8579-68585d8a7743 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:12.192922 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d1b6e213-bbc5-4aa9-8579-68585d8a7743 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:12.193557 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d1b6e213-bbc5-4aa9-8579-68585d8a7743 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:12.380731 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-d1b6e213-bbc5-4aa9-8579-68585d8a7743 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:12.390378 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-d1b6e213-bbc5-4aa9-8579-68585d8a7743 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:12.391959 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-d1b6e213-bbc5-4aa9-8579-68585d8a7743 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:12.393306 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-d1b6e213-bbc5-4aa9-8579-68585d8a7743 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1807 microversion: 2.20 time: 0.212474 Sep 02 17:12:12.394210 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 352/689] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:12 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1807 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:12:12.770116 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-d4424a71-2f74-4b39-8df5-05aa1133a5a1 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:12.771353 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-d4424a71-2f74-4b39-8df5-05aa1133a5a1 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 39f237e0-63e9-4871-9dd5-ab033d35ae67] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:12.777644 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d4424a71-2f74-4b39-8df5-05aa1133a5a1 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:12.778272 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d4424a71-2f74-4b39-8df5-05aa1133a5a1 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:12.779055 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d4424a71-2f74-4b39-8df5-05aa1133a5a1 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:12.779496 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d4424a71-2f74-4b39-8df5-05aa1133a5a1 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:12.961890 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-d4424a71-2f74-4b39-8df5-05aa1133a5a1 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:12.976324 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-d4424a71-2f74-4b39-8df5-05aa1133a5a1 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67" status: 200 len: 1318 microversion: 2.1 time: 0.208977 Sep 02 17:12:12.978058 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 353/690] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:12 2021] GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:12.986160 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-66601d08-dbde-427e-9bb7-0af9f833b0c3 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:12.987440 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-66601d08-dbde-427e-9bb7-0af9f833b0c3 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:12.997860 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-66601d08-dbde-427e-9bb7-0af9f833b0c3 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:12.998601 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-66601d08-dbde-427e-9bb7-0af9f833b0c3 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:13.000095 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-66601d08-dbde-427e-9bb7-0af9f833b0c3 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:13.000824 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-66601d08-dbde-427e-9bb7-0af9f833b0c3 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:13.123538 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-66601d08-dbde-427e-9bb7-0af9f833b0c3 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:13.137673 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-66601d08-dbde-427e-9bb7-0af9f833b0c3 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1137 microversion: 2.1 time: 0.157605 Sep 02 17:12:13.139276 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 354/691] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:12 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1137 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:13.411631 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-caf634c6-4216-4c33-b633-4be5ef7dc34f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:13.412369 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-caf634c6-4216-4c33-b633-4be5ef7dc34f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:13.418732 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-caf634c6-4216-4c33-b633-4be5ef7dc34f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:13.419252 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-caf634c6-4216-4c33-b633-4be5ef7dc34f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:13.420027 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-caf634c6-4216-4c33-b633-4be5ef7dc34f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:13.420459 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-caf634c6-4216-4c33-b633-4be5ef7dc34f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:13.568925 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-caf634c6-4216-4c33-b633-4be5ef7dc34f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:13.577497 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-caf634c6-4216-4c33-b633-4be5ef7dc34f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:13.579002 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-caf634c6-4216-4c33-b633-4be5ef7dc34f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:13.580143 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-caf634c6-4216-4c33-b633-4be5ef7dc34f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1807 microversion: 2.20 time: 0.172361 Sep 02 17:12:13.580869 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 355/692] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:13 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:12:13.997523 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-ba405a60-e7cc-4862-ae5f-d997199a2460 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:13.999309 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-ba405a60-e7cc-4862-ae5f-d997199a2460 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 39f237e0-63e9-4871-9dd5-ab033d35ae67] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:14.006897 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ba405a60-e7cc-4862-ae5f-d997199a2460 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:14.007316 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ba405a60-e7cc-4862-ae5f-d997199a2460 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:14.008267 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ba405a60-e7cc-4862-ae5f-d997199a2460 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:14.008847 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ba405a60-e7cc-4862-ae5f-d997199a2460 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:14.128606 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 17:12:14.129410 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: Thu Sep 2 17:12:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action (ip 10.222.0.41) !!! Sep 02 17:12:14.214337 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-ba405a60-e7cc-4862-ae5f-d997199a2460 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:14.221750 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-ba405a60-e7cc-4862-ae5f-d997199a2460 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67" status: 200 len: 1318 microversion: 2.1 time: 0.228931 Sep 02 17:12:14.222307 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 356/693] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:13 2021] GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:14.227809 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-956b7073-de14-4eb7-9bb8-b7876e01d4de tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:14.228499 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-956b7073-de14-4eb7-9bb8-b7876e01d4de tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:14.234406 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-956b7073-de14-4eb7-9bb8-b7876e01d4de tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:14.234881 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-956b7073-de14-4eb7-9bb8-b7876e01d4de tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:14.235943 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-956b7073-de14-4eb7-9bb8-b7876e01d4de tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:14.236359 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-956b7073-de14-4eb7-9bb8-b7876e01d4de tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:14.278101 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-956b7073-de14-4eb7-9bb8-b7876e01d4de tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Going to try to terminate instance {{(pid=108418) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 17:12:14.383482 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-956b7073-de14-4eb7-9bb8-b7876e01d4de tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "DELETE /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 204 len: 0 microversion: 2.1 time: 0.159134 Sep 02 17:12:14.384125 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 357/694] 10.222.0.41 () {58 vars in 1239 bytes} [Thu Sep 2 17:12:14 2021] DELETE /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 17:12:14.390999 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-6f66bbc1-2737-4d05-bbf9-e86b55a2585d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:14.391796 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-6f66bbc1-2737-4d05-bbf9-e86b55a2585d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:14.399376 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6f66bbc1-2737-4d05-bbf9-e86b55a2585d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:14.400011 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6f66bbc1-2737-4d05-bbf9-e86b55a2585d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:14.400784 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6f66bbc1-2737-4d05-bbf9-e86b55a2585d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:14.401211 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6f66bbc1-2737-4d05-bbf9-e86b55a2585d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:14.796389 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-6f66bbc1-2737-4d05-bbf9-e86b55a2585d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:14.806971 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-6f66bbc1-2737-4d05-bbf9-e86b55a2585d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1137 microversion: 2.1 time: 0.421274 Sep 02 17:12:14.812510 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 358/695] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:14 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1137 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:14.819081 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-1e3637a6-0117-45a6-bdad-a1b6ec2854b5 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:14.820468 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-1e3637a6-0117-45a6-bdad-a1b6ec2854b5 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:14.828868 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1e3637a6-0117-45a6-bdad-a1b6ec2854b5 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:14.829321 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1e3637a6-0117-45a6-bdad-a1b6ec2854b5 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:14.830121 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1e3637a6-0117-45a6-bdad-a1b6ec2854b5 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:14.830544 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1e3637a6-0117-45a6-bdad-a1b6ec2854b5 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:15.110254 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-1e3637a6-0117-45a6-bdad-a1b6ec2854b5 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:15.120266 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-1e3637a6-0117-45a6-bdad-a1b6ec2854b5 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1508 microversion: 2.1 time: 0.306264 Sep 02 17:12:15.121491 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 359/696] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:14 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1508 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:15.126408 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-823b3b46-4111-4d6f-83c1-93122ee22f9b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:15.127259 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-823b3b46-4111-4d6f-83c1-93122ee22f9b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:15.136446 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-823b3b46-4111-4d6f-83c1-93122ee22f9b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:15.136898 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-823b3b46-4111-4d6f-83c1-93122ee22f9b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:15.137674 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-823b3b46-4111-4d6f-83c1-93122ee22f9b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:15.138103 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-823b3b46-4111-4d6f-83c1-93122ee22f9b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:15.322443 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-823b3b46-4111-4d6f-83c1-93122ee22f9b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:15.334893 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-823b3b46-4111-4d6f-83c1-93122ee22f9b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:15.336904 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-823b3b46-4111-4d6f-83c1-93122ee22f9b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:15.339124 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-823b3b46-4111-4d6f-83c1-93122ee22f9b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1807 microversion: 2.20 time: 0.216150 Sep 02 17:12:15.350592 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 360/697] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:15 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1807 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:12:15.355826 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-6d112686-1c58-4f46-9197-2809939bd5c8 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:15.356807 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-6d112686-1c58-4f46-9197-2809939bd5c8 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 39f237e0-63e9-4871-9dd5-ab033d35ae67] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:15.365091 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6d112686-1c58-4f46-9197-2809939bd5c8 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:15.365673 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6d112686-1c58-4f46-9197-2809939bd5c8 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:15.366218 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6d112686-1c58-4f46-9197-2809939bd5c8 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:15.366673 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6d112686-1c58-4f46-9197-2809939bd5c8 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:15.576139 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-6d112686-1c58-4f46-9197-2809939bd5c8 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:15.583829 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-6d112686-1c58-4f46-9197-2809939bd5c8 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67" status: 200 len: 1318 microversion: 2.1 time: 0.231873 Sep 02 17:12:15.584653 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 361/698] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:15 2021] GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:15.831900 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-225a4428-24b7-430d-b955-264432312f17 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:15.832596 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-225a4428-24b7-430d-b955-264432312f17 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:15.843017 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-225a4428-24b7-430d-b955-264432312f17 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:15.843017 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-225a4428-24b7-430d-b955-264432312f17 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:15.843017 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-225a4428-24b7-430d-b955-264432312f17 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:15.843017 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-225a4428-24b7-430d-b955-264432312f17 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:15.942873 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-225a4428-24b7-430d-b955-264432312f17 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:15.954759 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-225a4428-24b7-430d-b955-264432312f17 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1137 microversion: 2.1 time: 0.129132 Sep 02 17:12:15.964627 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 362/699] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:15 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1137 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:16.138796 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-331d55a7-78cf-4e8d-b594-73e1eb527f19 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:16.140759 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-331d55a7-78cf-4e8d-b594-73e1eb527f19 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:16.148812 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-331d55a7-78cf-4e8d-b594-73e1eb527f19 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:16.149553 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-331d55a7-78cf-4e8d-b594-73e1eb527f19 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:16.150530 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-331d55a7-78cf-4e8d-b594-73e1eb527f19 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:16.151424 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-331d55a7-78cf-4e8d-b594-73e1eb527f19 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:16.337886 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-331d55a7-78cf-4e8d-b594-73e1eb527f19 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:16.351938 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-331d55a7-78cf-4e8d-b594-73e1eb527f19 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1508 microversion: 2.1 time: 0.217075 Sep 02 17:12:16.361699 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 363/700] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:16 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1508 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:16.390177 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-93081bd8-572e-4d40-af22-6ef02db14b74 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:16.390919 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-93081bd8-572e-4d40-af22-6ef02db14b74 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:16.400454 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-93081bd8-572e-4d40-af22-6ef02db14b74 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:16.400988 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-93081bd8-572e-4d40-af22-6ef02db14b74 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:16.401827 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-93081bd8-572e-4d40-af22-6ef02db14b74 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:16.402344 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-93081bd8-572e-4d40-af22-6ef02db14b74 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:16.636910 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-93081bd8-572e-4d40-af22-6ef02db14b74 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:16.650450 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-93081bd8-572e-4d40-af22-6ef02db14b74 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:16.650450 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-93081bd8-572e-4d40-af22-6ef02db14b74 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:16.650450 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-93081bd8-572e-4d40-af22-6ef02db14b74 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1807 microversion: 2.20 time: 0.292080 Sep 02 17:12:16.650923 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 364/701] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:16 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1807 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:12:16.666414 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-a9174293-c2b1-4dce-84c4-a1a33a5850bb tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:16.667046 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-a9174293-c2b1-4dce-84c4-a1a33a5850bb tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 39f237e0-63e9-4871-9dd5-ab033d35ae67] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:16.683656 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a9174293-c2b1-4dce-84c4-a1a33a5850bb tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:16.684176 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a9174293-c2b1-4dce-84c4-a1a33a5850bb tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:16.685031 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a9174293-c2b1-4dce-84c4-a1a33a5850bb tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:16.685530 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a9174293-c2b1-4dce-84c4-a1a33a5850bb tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:16.826551 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-a9174293-c2b1-4dce-84c4-a1a33a5850bb tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:16.835742 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-a9174293-c2b1-4dce-84c4-a1a33a5850bb tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67" status: 200 len: 1318 microversion: 2.1 time: 0.183863 Sep 02 17:12:16.836538 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 365/702] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:16 2021] GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:16.972289 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-932de82a-1378-4513-85b1-dbd52ad46235 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:16.973239 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-932de82a-1378-4513-85b1-dbd52ad46235 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:16.983550 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-932de82a-1378-4513-85b1-dbd52ad46235 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:16.984314 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-932de82a-1378-4513-85b1-dbd52ad46235 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:16.985422 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-932de82a-1378-4513-85b1-dbd52ad46235 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:16.985890 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-932de82a-1378-4513-85b1-dbd52ad46235 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:17.067051 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-932de82a-1378-4513-85b1-dbd52ad46235 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:17.076638 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-932de82a-1378-4513-85b1-dbd52ad46235 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1137 microversion: 2.1 time: 0.108390 Sep 02 17:12:17.077412 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 366/703] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:16 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1137 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:17.370642 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-ceeeff21-701e-43ce-a92f-ef88072c4ef9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:17.371604 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-ceeeff21-701e-43ce-a92f-ef88072c4ef9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:17.377344 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ceeeff21-701e-43ce-a92f-ef88072c4ef9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:17.378053 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ceeeff21-701e-43ce-a92f-ef88072c4ef9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:17.379059 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ceeeff21-701e-43ce-a92f-ef88072c4ef9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:17.379730 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ceeeff21-701e-43ce-a92f-ef88072c4ef9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:17.616882 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-ceeeff21-701e-43ce-a92f-ef88072c4ef9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:17.625536 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-ceeeff21-701e-43ce-a92f-ef88072c4ef9 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1508 microversion: 2.1 time: 0.258488 Sep 02 17:12:17.626320 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 367/704] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:17 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1508 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:17.668990 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-a1f89cab-6488-49e3-9bb5-c3f78fdfd32e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:17.669602 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-a1f89cab-6488-49e3-9bb5-c3f78fdfd32e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:17.675743 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a1f89cab-6488-49e3-9bb5-c3f78fdfd32e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:17.676295 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a1f89cab-6488-49e3-9bb5-c3f78fdfd32e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:17.678025 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a1f89cab-6488-49e3-9bb5-c3f78fdfd32e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:17.678467 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a1f89cab-6488-49e3-9bb5-c3f78fdfd32e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:17.847639 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-a1f89cab-6488-49e3-9bb5-c3f78fdfd32e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:17.858356 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-a1f89cab-6488-49e3-9bb5-c3f78fdfd32e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:17.859960 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-a1f89cab-6488-49e3-9bb5-c3f78fdfd32e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:17.861476 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-a1f89cab-6488-49e3-9bb5-c3f78fdfd32e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1807 microversion: 2.20 time: 0.196793 Sep 02 17:12:17.873625 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 368/705] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:17 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1807 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:12:17.878670 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-2e94ceb4-209a-4c8b-99ca-264a2269a371 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:17.879287 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-2e94ceb4-209a-4c8b-99ca-264a2269a371 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 39f237e0-63e9-4871-9dd5-ab033d35ae67] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:17.885516 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2e94ceb4-209a-4c8b-99ca-264a2269a371 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:17.885963 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2e94ceb4-209a-4c8b-99ca-264a2269a371 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:17.886771 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2e94ceb4-209a-4c8b-99ca-264a2269a371 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:17.887206 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2e94ceb4-209a-4c8b-99ca-264a2269a371 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:18.063147 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-2e94ceb4-209a-4c8b-99ca-264a2269a371 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:18.072903 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-2e94ceb4-209a-4c8b-99ca-264a2269a371 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67" status: 200 len: 1318 microversion: 2.1 time: 0.197635 Sep 02 17:12:18.073508 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 369/706] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:17 2021] GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67 => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:18.096153 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-e148571b-665e-4d59-a987-5bb76db7e3a0 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:18.096975 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-e148571b-665e-4d59-a987-5bb76db7e3a0 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:18.106359 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e148571b-665e-4d59-a987-5bb76db7e3a0 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:18.110354 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e148571b-665e-4d59-a987-5bb76db7e3a0 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:18.110354 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e148571b-665e-4d59-a987-5bb76db7e3a0 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:18.110354 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e148571b-665e-4d59-a987-5bb76db7e3a0 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:18.196460 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-e148571b-665e-4d59-a987-5bb76db7e3a0 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:18.205078 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-e148571b-665e-4d59-a987-5bb76db7e3a0 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1137 microversion: 2.1 time: 0.115504 Sep 02 17:12:18.205941 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 370/707] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:18 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1137 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:18.642872 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-0dcf0a8a-4130-4684-951d-1541b88de535 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:18.643544 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-0dcf0a8a-4130-4684-951d-1541b88de535 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:18.649787 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-0dcf0a8a-4130-4684-951d-1541b88de535 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:18.650235 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-0dcf0a8a-4130-4684-951d-1541b88de535 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:18.651043 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-0dcf0a8a-4130-4684-951d-1541b88de535 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:18.651480 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-0dcf0a8a-4130-4684-951d-1541b88de535 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:18.806873 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-0dcf0a8a-4130-4684-951d-1541b88de535 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:18.814876 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-0dcf0a8a-4130-4684-951d-1541b88de535 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1508 microversion: 2.1 time: 0.176140 Sep 02 17:12:18.815774 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 371/708] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:18 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1508 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:18.881058 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-786788a6-76a3-4f1a-9960-68a465cf0030 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:18.881668 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-786788a6-76a3-4f1a-9960-68a465cf0030 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:18.887665 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-786788a6-76a3-4f1a-9960-68a465cf0030 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:18.888113 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-786788a6-76a3-4f1a-9960-68a465cf0030 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:18.888931 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-786788a6-76a3-4f1a-9960-68a465cf0030 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:18.889313 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-786788a6-76a3-4f1a-9960-68a465cf0030 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:19.036956 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-786788a6-76a3-4f1a-9960-68a465cf0030 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:19.046101 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-786788a6-76a3-4f1a-9960-68a465cf0030 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:19.047627 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-786788a6-76a3-4f1a-9960-68a465cf0030 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:19.048845 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-786788a6-76a3-4f1a-9960-68a465cf0030 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1807 microversion: 2.20 time: 0.171995 Sep 02 17:12:19.049396 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 372/709] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:18 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:12:19.089399 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-57fb66b8-3dc6-4b11-a1c4-cee4b1781220 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:19.090114 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-57fb66b8-3dc6-4b11-a1c4-cee4b1781220 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 39f237e0-63e9-4871-9dd5-ab033d35ae67] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:19.099690 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-57fb66b8-3dc6-4b11-a1c4-cee4b1781220 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:19.100138 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-57fb66b8-3dc6-4b11-a1c4-cee4b1781220 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:19.100928 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-57fb66b8-3dc6-4b11-a1c4-cee4b1781220 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:19.101369 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-57fb66b8-3dc6-4b11-a1c4-cee4b1781220 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:19.245109 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-57fb66b8-3dc6-4b11-a1c4-cee4b1781220 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:19.253186 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-57fb66b8-3dc6-4b11-a1c4-cee4b1781220 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67" status: 200 len: 1318 microversion: 2.1 time: 0.167414 Sep 02 17:12:19.262703 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 373/710] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:19 2021] GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:19.262703 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-588aacd6-8239-4d59-a417-4dcfa6b17caf tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:19.262703 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-588aacd6-8239-4d59-a417-4dcfa6b17caf tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:19.265311 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-588aacd6-8239-4d59-a417-4dcfa6b17caf tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:19.265763 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-588aacd6-8239-4d59-a417-4dcfa6b17caf tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:19.266542 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-588aacd6-8239-4d59-a417-4dcfa6b17caf tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:19.267010 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-588aacd6-8239-4d59-a417-4dcfa6b17caf tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:19.349170 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-588aacd6-8239-4d59-a417-4dcfa6b17caf tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:19.356740 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-588aacd6-8239-4d59-a417-4dcfa6b17caf tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1137 microversion: 2.1 time: 0.101349 Sep 02 17:12:19.357307 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 374/711] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:19 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1137 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:19.833664 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-02865591-4950-490e-8989-3a58e9dec168 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:19.835274 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-02865591-4950-490e-8989-3a58e9dec168 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:19.844382 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-02865591-4950-490e-8989-3a58e9dec168 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:19.844835 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-02865591-4950-490e-8989-3a58e9dec168 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:19.845613 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-02865591-4950-490e-8989-3a58e9dec168 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:19.846042 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-02865591-4950-490e-8989-3a58e9dec168 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:19.980823 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-02865591-4950-490e-8989-3a58e9dec168 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:19.989201 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-02865591-4950-490e-8989-3a58e9dec168 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1508 microversion: 2.1 time: 0.160817 Sep 02 17:12:19.990069 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 375/712] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:19 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:20.069545 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-e53cfed2-f722-47e1-8875-69957c68d04a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:20.070683 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-e53cfed2-f722-47e1-8875-69957c68d04a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:20.082534 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e53cfed2-f722-47e1-8875-69957c68d04a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:20.083312 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e53cfed2-f722-47e1-8875-69957c68d04a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:20.084281 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e53cfed2-f722-47e1-8875-69957c68d04a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:20.084872 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e53cfed2-f722-47e1-8875-69957c68d04a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:20.237822 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-e53cfed2-f722-47e1-8875-69957c68d04a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:20.247096 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-e53cfed2-f722-47e1-8875-69957c68d04a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:20.248838 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-e53cfed2-f722-47e1-8875-69957c68d04a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:20.254083 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-e53cfed2-f722-47e1-8875-69957c68d04a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1807 microversion: 2.20 time: 0.189794 Sep 02 17:12:20.259033 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 376/713] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:20 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1807 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:12:20.273983 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-1d6b38a5-f2b3-4b74-9eac-2d6e03f2d479 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:20.274923 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-1d6b38a5-f2b3-4b74-9eac-2d6e03f2d479 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 39f237e0-63e9-4871-9dd5-ab033d35ae67] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:20.281410 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1d6b38a5-f2b3-4b74-9eac-2d6e03f2d479 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:20.282048 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1d6b38a5-f2b3-4b74-9eac-2d6e03f2d479 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:20.283098 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1d6b38a5-f2b3-4b74-9eac-2d6e03f2d479 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:20.283683 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1d6b38a5-f2b3-4b74-9eac-2d6e03f2d479 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:20.448084 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-1d6b38a5-f2b3-4b74-9eac-2d6e03f2d479 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:20.464249 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-1d6b38a5-f2b3-4b74-9eac-2d6e03f2d479 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67" status: 200 len: 1318 microversion: 2.1 time: 0.194866 Sep 02 17:12:20.470516 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 377/714] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:20 2021] GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:20.475911 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-f085dc72-5044-47be-aeb8-1575563e0a47 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:20.480040 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-f085dc72-5044-47be-aeb8-1575563e0a47 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:20.488321 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f085dc72-5044-47be-aeb8-1575563e0a47 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:20.489874 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f085dc72-5044-47be-aeb8-1575563e0a47 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:20.490957 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f085dc72-5044-47be-aeb8-1575563e0a47 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:20.491397 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f085dc72-5044-47be-aeb8-1575563e0a47 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:20.564449 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-f085dc72-5044-47be-aeb8-1575563e0a47 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:20.572687 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-f085dc72-5044-47be-aeb8-1575563e0a47 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1137 microversion: 2.1 time: 0.100440 Sep 02 17:12:20.573467 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 378/715] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:20 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1137 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:21.007156 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-44c83457-5577-44f5-b377-0954e997b79b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:21.007893 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-44c83457-5577-44f5-b377-0954e997b79b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:21.013875 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-44c83457-5577-44f5-b377-0954e997b79b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:21.014326 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-44c83457-5577-44f5-b377-0954e997b79b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:21.015127 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-44c83457-5577-44f5-b377-0954e997b79b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:21.015567 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-44c83457-5577-44f5-b377-0954e997b79b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:21.143563 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-44c83457-5577-44f5-b377-0954e997b79b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:21.151561 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-44c83457-5577-44f5-b377-0954e997b79b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1508 microversion: 2.1 time: 0.148888 Sep 02 17:12:21.152127 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 379/716] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:21 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:21.274727 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-5cede67b-8726-4197-b216-b6adc76d4b97 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:21.275365 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-5cede67b-8726-4197-b216-b6adc76d4b97 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:21.281528 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5cede67b-8726-4197-b216-b6adc76d4b97 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:21.282058 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5cede67b-8726-4197-b216-b6adc76d4b97 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:21.282934 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5cede67b-8726-4197-b216-b6adc76d4b97 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:21.283443 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5cede67b-8726-4197-b216-b6adc76d4b97 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:21.406086 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-5cede67b-8726-4197-b216-b6adc76d4b97 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:21.415127 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-5cede67b-8726-4197-b216-b6adc76d4b97 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:21.417325 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-5cede67b-8726-4197-b216-b6adc76d4b97 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:21.417826 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-5cede67b-8726-4197-b216-b6adc76d4b97 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1807 microversion: 2.20 time: 0.147651 Sep 02 17:12:21.418412 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 380/717] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:21 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1807 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:12:21.483734 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-c4821f12-b432-4bec-8488-c1a02385e262 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:21.484456 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-c4821f12-b432-4bec-8488-c1a02385e262 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 39f237e0-63e9-4871-9dd5-ab033d35ae67] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:21.490604 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c4821f12-b432-4bec-8488-c1a02385e262 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:21.491086 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c4821f12-b432-4bec-8488-c1a02385e262 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:21.491847 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c4821f12-b432-4bec-8488-c1a02385e262 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:21.492280 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c4821f12-b432-4bec-8488-c1a02385e262 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:21.614445 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-c4821f12-b432-4bec-8488-c1a02385e262 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:21.621577 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-c4821f12-b432-4bec-8488-c1a02385e262 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67" status: 200 len: 1318 microversion: 2.1 time: 0.141517 Sep 02 17:12:21.622122 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 381/718] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:21 2021] GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67 => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:21.626269 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-f98a035e-7856-4fda-b95e-eb49c74c8a5d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:21.626891 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-f98a035e-7856-4fda-b95e-eb49c74c8a5d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:21.632863 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f98a035e-7856-4fda-b95e-eb49c74c8a5d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:21.633305 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f98a035e-7856-4fda-b95e-eb49c74c8a5d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:21.634052 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f98a035e-7856-4fda-b95e-eb49c74c8a5d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:21.634478 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f98a035e-7856-4fda-b95e-eb49c74c8a5d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:21.696405 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-f98a035e-7856-4fda-b95e-eb49c74c8a5d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:21.703629 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-f98a035e-7856-4fda-b95e-eb49c74c8a5d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1137 microversion: 2.1 time: 0.080571 Sep 02 17:12:21.704183 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 382/719] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:21 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1137 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:22.167469 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-7eda178a-03cd-490c-8b59-e6d522d71f8d tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:22.168121 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-7eda178a-03cd-490c-8b59-e6d522d71f8d tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:22.173690 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7eda178a-03cd-490c-8b59-e6d522d71f8d tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:22.174136 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7eda178a-03cd-490c-8b59-e6d522d71f8d tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:22.174922 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7eda178a-03cd-490c-8b59-e6d522d71f8d tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:22.175410 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7eda178a-03cd-490c-8b59-e6d522d71f8d tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:22.297326 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-7eda178a-03cd-490c-8b59-e6d522d71f8d tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:22.305034 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-7eda178a-03cd-490c-8b59-e6d522d71f8d tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1508 microversion: 2.1 time: 0.141335 Sep 02 17:12:22.305591 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 383/720] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:22 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1508 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:22.435380 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-376cc4ff-5a42-46eb-bed5-de931d223dff tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:22.435919 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-376cc4ff-5a42-46eb-bed5-de931d223dff tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:22.441772 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-376cc4ff-5a42-46eb-bed5-de931d223dff tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:22.442879 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-376cc4ff-5a42-46eb-bed5-de931d223dff tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:22.443687 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-376cc4ff-5a42-46eb-bed5-de931d223dff tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:22.444121 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-376cc4ff-5a42-46eb-bed5-de931d223dff tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:22.563250 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-376cc4ff-5a42-46eb-bed5-de931d223dff tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:22.572117 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-376cc4ff-5a42-46eb-bed5-de931d223dff tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:22.573619 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-376cc4ff-5a42-46eb-bed5-de931d223dff tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:22.574824 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-376cc4ff-5a42-46eb-bed5-de931d223dff tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1807 microversion: 2.20 time: 0.143196 Sep 02 17:12:22.575379 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 384/721] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:22 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1807 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:12:22.638278 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-c8ad0f64-5044-4725-828e-ce6ab1a39d37 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:22.638917 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-c8ad0f64-5044-4725-828e-ce6ab1a39d37 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 39f237e0-63e9-4871-9dd5-ab033d35ae67] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:22.644780 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c8ad0f64-5044-4725-828e-ce6ab1a39d37 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:22.645228 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c8ad0f64-5044-4725-828e-ce6ab1a39d37 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:22.646001 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c8ad0f64-5044-4725-828e-ce6ab1a39d37 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:22.646433 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c8ad0f64-5044-4725-828e-ce6ab1a39d37 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:22.770040 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-c8ad0f64-5044-4725-828e-ce6ab1a39d37 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:22.777254 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-c8ad0f64-5044-4725-828e-ce6ab1a39d37 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67" status: 200 len: 1318 microversion: 2.1 time: 0.142507 Sep 02 17:12:22.777805 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 385/722] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:22 2021] GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67 => generated 1318 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:22.781944 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-d174661d-499c-4604-a319-f7e7379e920e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:22.782536 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-d174661d-499c-4604-a319-f7e7379e920e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:22.788753 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d174661d-499c-4604-a319-f7e7379e920e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:22.789202 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d174661d-499c-4604-a319-f7e7379e920e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:22.789967 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d174661d-499c-4604-a319-f7e7379e920e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:22.790433 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d174661d-499c-4604-a319-f7e7379e920e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:22.847895 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-d174661d-499c-4604-a319-f7e7379e920e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:22.855928 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-d174661d-499c-4604-a319-f7e7379e920e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1137 microversion: 2.1 time: 0.077160 Sep 02 17:12:22.856485 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 386/723] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:22 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1137 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:23.322706 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-151fe35b-41d7-4458-8faf-d91054f18ee5 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:23.323343 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-151fe35b-41d7-4458-8faf-d91054f18ee5 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:23.329332 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-151fe35b-41d7-4458-8faf-d91054f18ee5 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:23.329780 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-151fe35b-41d7-4458-8faf-d91054f18ee5 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:23.330551 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-151fe35b-41d7-4458-8faf-d91054f18ee5 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:23.331012 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-151fe35b-41d7-4458-8faf-d91054f18ee5 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:23.388561 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-fae988c2-7bee-4e96-aa79-722929a9fefd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 11.469887 Sep 02 17:12:23.389985 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 338/724] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:12:11 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 11472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:12:23.462243 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-151fe35b-41d7-4458-8faf-d91054f18ee5 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:23.469805 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-151fe35b-41d7-4458-8faf-d91054f18ee5 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1508 microversion: 2.1 time: 0.152454 Sep 02 17:12:23.470362 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 387/725] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:23 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:23.593042 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-de652d78-6e5e-4b27-99d6-88c8b42cce49 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:23.593922 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-de652d78-6e5e-4b27-99d6-88c8b42cce49 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:23.601334 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-de652d78-6e5e-4b27-99d6-88c8b42cce49 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:23.601784 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-de652d78-6e5e-4b27-99d6-88c8b42cce49 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:23.602803 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-de652d78-6e5e-4b27-99d6-88c8b42cce49 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:23.603226 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-de652d78-6e5e-4b27-99d6-88c8b42cce49 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:23.733021 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-de652d78-6e5e-4b27-99d6-88c8b42cce49 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:23.742159 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-de652d78-6e5e-4b27-99d6-88c8b42cce49 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:23.743675 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-de652d78-6e5e-4b27-99d6-88c8b42cce49 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:23.744839 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-de652d78-6e5e-4b27-99d6-88c8b42cce49 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1807 microversion: 2.20 time: 0.156005 Sep 02 17:12:23.745393 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 339/726] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:23 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:12:23.794127 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-7f3282e8-b7ad-4815-9382-001b9537720c tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:23.794788 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-7f3282e8-b7ad-4815-9382-001b9537720c tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 39f237e0-63e9-4871-9dd5-ab033d35ae67] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:23.800425 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7f3282e8-b7ad-4815-9382-001b9537720c tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:23.800901 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7f3282e8-b7ad-4815-9382-001b9537720c tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:23.801663 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7f3282e8-b7ad-4815-9382-001b9537720c tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:23.802091 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7f3282e8-b7ad-4815-9382-001b9537720c tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:23.873430 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-b873c05c-8396-4f19-a0b0-b91018dea99a tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:23.874045 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-b873c05c-8396-4f19-a0b0-b91018dea99a tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:23.880022 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b873c05c-8396-4f19-a0b0-b91018dea99a tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:23.880335 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b873c05c-8396-4f19-a0b0-b91018dea99a tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:23.881118 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b873c05c-8396-4f19-a0b0-b91018dea99a tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:23.881552 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b873c05c-8396-4f19-a0b0-b91018dea99a tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:23.946575 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-b873c05c-8396-4f19-a0b0-b91018dea99a tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:23.955345 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-b873c05c-8396-4f19-a0b0-b91018dea99a tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1193 microversion: 2.1 time: 0.085656 Sep 02 17:12:23.956128 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 340/727] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:23 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1193 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:23.986702 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-7f3282e8-b7ad-4815-9382-001b9537720c tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:23.996346 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-7f3282e8-b7ad-4815-9382-001b9537720c tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67" status: 200 len: 1505 microversion: 2.1 time: 0.205745 Sep 02 17:12:23.997184 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 388/728] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:23 2021] GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67 => generated 1505 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:24.014123 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-1dc30765-9ade-4a3c-8fd3-fc6a700ce080 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a26f825-ade3-42bc-a74d-2b8c5041779a", "device": "/dev/sdb"}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:24.015241 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-1dc30765-9ade-4a3c-8fd3-fc6a700ce080 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 39f237e0-63e9-4871-9dd5-ab033d35ae67] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:24.021853 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1dc30765-9ade-4a3c-8fd3-fc6a700ce080 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:24.022260 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1dc30765-9ade-4a3c-8fd3-fc6a700ce080 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:24.023065 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1dc30765-9ade-4a3c-8fd3-fc6a700ce080 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:24.023721 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1dc30765-9ade-4a3c-8fd3-fc6a700ce080 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:24.339712 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-1dc30765-9ade-4a3c-8fd3-fc6a700ce080 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "POST /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329071 Sep 02 17:12:24.340662 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 341/729] 10.222.0.41 () {60 vars in 1323 bytes} [Thu Sep 2 17:12:24 2021] POST /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67/os-volume_attachments => generated 194 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:12:24.401222 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-38911f7c-3a38-4fc6-bfe2-6fa667f060f8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:24.402275 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-38911f7c-3a38-4fc6-bfe2-6fa667f060f8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:24.409671 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-38911f7c-3a38-4fc6-bfe2-6fa667f060f8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:24.410129 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-38911f7c-3a38-4fc6-bfe2-6fa667f060f8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:24.411051 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-38911f7c-3a38-4fc6-bfe2-6fa667f060f8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:24.411450 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-38911f7c-3a38-4fc6-bfe2-6fa667f060f8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:24.487785 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-cbaefb99-0d6f-4a65-8aed-b55534d033a8 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:24.488553 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-cbaefb99-0d6f-4a65-8aed-b55534d033a8 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:24.494796 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-cbaefb99-0d6f-4a65-8aed-b55534d033a8 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:24.495296 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-cbaefb99-0d6f-4a65-8aed-b55534d033a8 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:24.496235 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-cbaefb99-0d6f-4a65-8aed-b55534d033a8 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:24.496792 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-cbaefb99-0d6f-4a65-8aed-b55534d033a8 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:24.507011 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-38911f7c-3a38-4fc6-bfe2-6fa667f060f8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.109378 Sep 02 17:12:24.508864 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 389/730] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:12:24 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:12:24.736431 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-cbaefb99-0d6f-4a65-8aed-b55534d033a8 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:24.744998 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-cbaefb99-0d6f-4a65-8aed-b55534d033a8 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1508 microversion: 2.1 time: 0.261689 Sep 02 17:12:24.754276 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 342/731] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:24 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1508 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:24.762683 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-b9ecfdb8-ba67-421c-b55f-4b82b934f62e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:24.763472 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-b9ecfdb8-ba67-421c-b55f-4b82b934f62e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:24.772224 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b9ecfdb8-ba67-421c-b55f-4b82b934f62e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:24.772916 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b9ecfdb8-ba67-421c-b55f-4b82b934f62e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:24.773906 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b9ecfdb8-ba67-421c-b55f-4b82b934f62e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:24.774493 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b9ecfdb8-ba67-421c-b55f-4b82b934f62e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:24.917746 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-b9ecfdb8-ba67-421c-b55f-4b82b934f62e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:24.938110 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-b9ecfdb8-ba67-421c-b55f-4b82b934f62e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:24.943364 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-b9ecfdb8-ba67-421c-b55f-4b82b934f62e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:24.944573 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-b9ecfdb8-ba67-421c-b55f-4b82b934f62e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1807 microversion: 2.20 time: 0.186149 Sep 02 17:12:24.948983 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 390/732] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:24 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:12:24.972379 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-37c6ef9b-3e3d-4443-ad93-5e85017a802f tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:24.972905 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-37c6ef9b-3e3d-4443-ad93-5e85017a802f tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:24.979488 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-37c6ef9b-3e3d-4443-ad93-5e85017a802f tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:24.980141 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-37c6ef9b-3e3d-4443-ad93-5e85017a802f tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:24.981149 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-37c6ef9b-3e3d-4443-ad93-5e85017a802f tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:24.981740 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-37c6ef9b-3e3d-4443-ad93-5e85017a802f tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:25.453227 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-37c6ef9b-3e3d-4443-ad93-5e85017a802f tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:25.462332 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-37c6ef9b-3e3d-4443-ad93-5e85017a802f tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1279 microversion: 2.1 time: 0.493532 Sep 02 17:12:25.472185 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 343/733] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:24 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1279 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:25.519345 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-5afba424-2f8b-4464-9a2e-4f684167e707 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:25.522165 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-5afba424-2f8b-4464-9a2e-4f684167e707 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:25.528585 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5afba424-2f8b-4464-9a2e-4f684167e707 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:25.529033 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5afba424-2f8b-4464-9a2e-4f684167e707 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:25.529808 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5afba424-2f8b-4464-9a2e-4f684167e707 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:25.530434 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5afba424-2f8b-4464-9a2e-4f684167e707 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:25.630408 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-5afba424-2f8b-4464-9a2e-4f684167e707 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.114010 Sep 02 17:12:25.631076 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 391/734] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:12:25 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:12:25.762758 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-dbc57434-13d2-428c-b76c-92c176ec4e41 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:25.763414 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-dbc57434-13d2-428c-b76c-92c176ec4e41 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:25.771095 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-dbc57434-13d2-428c-b76c-92c176ec4e41 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:25.771095 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-dbc57434-13d2-428c-b76c-92c176ec4e41 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:25.773695 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-dbc57434-13d2-428c-b76c-92c176ec4e41 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:25.774146 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-dbc57434-13d2-428c-b76c-92c176ec4e41 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:25.979175 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-f2916f03-f777-47e3-b838-4d01cb74e541 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:25.979996 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-f2916f03-f777-47e3-b838-4d01cb74e541 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:25.992901 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f2916f03-f777-47e3-b838-4d01cb74e541 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:25.992901 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f2916f03-f777-47e3-b838-4d01cb74e541 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:25.993692 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f2916f03-f777-47e3-b838-4d01cb74e541 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:25.994126 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f2916f03-f777-47e3-b838-4d01cb74e541 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:26.030179 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-dbc57434-13d2-428c-b76c-92c176ec4e41 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:26.058578 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-dbc57434-13d2-428c-b76c-92c176ec4e41 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1508 microversion: 2.1 time: 0.300265 Sep 02 17:12:26.070805 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 344/735] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:25 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1508 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:26.189055 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-f2916f03-f777-47e3-b838-4d01cb74e541 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:26.199385 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-f2916f03-f777-47e3-b838-4d01cb74e541 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:26.200465 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-f2916f03-f777-47e3-b838-4d01cb74e541 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:26.201750 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-f2916f03-f777-47e3-b838-4d01cb74e541 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1807 microversion: 2.20 time: 0.237260 Sep 02 17:12:26.202666 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 392/736] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:25 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1807 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:12:26.231133 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [req-c0e49904-c934-4166-a56e-5c71f5491a51 req-06a8d8d8-9dac-4ab2-aa38-59264c7a187e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34e36f29-2bc8-4586-8de2-3a218984c046", "tag": "1af31c9b-4bff-4dc7-8b17-98d43795b25a"}]} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:26.233009 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:12:26.233009 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: warnings.warn(msg) Sep 02 17:12:26.241015 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-c0e49904-c934-4166-a56e-5c71f5491a51 req-06a8d8d8-9dac-4ab2-aa38-59264c7a187e service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:26.241497 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-c0e49904-c934-4166-a56e-5c71f5491a51 req-06a8d8d8-9dac-4ab2-aa38-59264c7a187e service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:26.258257 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.compute.server_external_events [req-c0e49904-c934-4166-a56e-5c71f5491a51 req-06a8d8d8-9dac-4ab2-aa38-59264c7a187e service nova] Creating event network-changed:1af31c9b-4bff-4dc7-8b17-98d43795b25a for instance 34e36f29-2bc8-4586-8de2-3a218984c046 on hv-cinder-80626 Sep 02 17:12:26.263121 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [req-c0e49904-c934-4166-a56e-5c71f5491a51 req-06a8d8d8-9dac-4ab2-aa38-59264c7a187e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036421 Sep 02 17:12:26.263775 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 345/737] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:12:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:12:26.479691 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-a427b7c4-81bf-470a-80ea-552beb2edf29 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:26.480252 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-a427b7c4-81bf-470a-80ea-552beb2edf29 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:26.486016 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a427b7c4-81bf-470a-80ea-552beb2edf29 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:26.486444 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a427b7c4-81bf-470a-80ea-552beb2edf29 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:26.487537 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a427b7c4-81bf-470a-80ea-552beb2edf29 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:26.488013 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a427b7c4-81bf-470a-80ea-552beb2edf29 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:26.642639 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-239dfcbb-ba0d-4653-bf07-6b3ec1c49143 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:26.643787 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-239dfcbb-ba0d-4653-bf07-6b3ec1c49143 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:26.651237 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-239dfcbb-ba0d-4653-bf07-6b3ec1c49143 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:26.653211 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-239dfcbb-ba0d-4653-bf07-6b3ec1c49143 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:26.656277 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-239dfcbb-ba0d-4653-bf07-6b3ec1c49143 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:26.657271 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-239dfcbb-ba0d-4653-bf07-6b3ec1c49143 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:26.706335 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-a427b7c4-81bf-470a-80ea-552beb2edf29 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:26.719562 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-a427b7c4-81bf-470a-80ea-552beb2edf29 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1267 microversion: 2.1 time: 0.243293 Sep 02 17:12:26.720496 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 393/738] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:26 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1267 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:26.774661 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-239dfcbb-ba0d-4653-bf07-6b3ec1c49143 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.135834 Sep 02 17:12:26.775710 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 346/739] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:12:26 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:12:27.083093 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-39f6176c-ca21-4ed8-9614-202673c77b5f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:27.083710 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-39f6176c-ca21-4ed8-9614-202673c77b5f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:27.099455 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-39f6176c-ca21-4ed8-9614-202673c77b5f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:27.100135 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-39f6176c-ca21-4ed8-9614-202673c77b5f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:27.100944 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-39f6176c-ca21-4ed8-9614-202673c77b5f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:27.101387 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-39f6176c-ca21-4ed8-9614-202673c77b5f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:27.115490 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [req-cc4a2963-2337-4e75-b5af-60d0f0686101 req-3ce98fb0-4562-47e7-b152-84344d410ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8c6e69a-9463-455b-b782-db0bcadacc9e", "name": "network-vif-deleted", "tag": "78ccaec8-38fe-4511-a0ec-b9b938bb39a5"}]} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:27.116970 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:12:27.116970 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: warnings.warn(msg) Sep 02 17:12:27.134389 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-cc4a2963-2337-4e75-b5af-60d0f0686101 req-3ce98fb0-4562-47e7-b152-84344d410ee7 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:27.134869 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-cc4a2963-2337-4e75-b5af-60d0f0686101 req-3ce98fb0-4562-47e7-b152-84344d410ee7 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:27.149240 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.compute.server_external_events [req-cc4a2963-2337-4e75-b5af-60d0f0686101 req-3ce98fb0-4562-47e7-b152-84344d410ee7 service nova] Creating event network-vif-deleted:78ccaec8-38fe-4511-a0ec-b9b938bb39a5 for instance e8c6e69a-9463-455b-b782-db0bcadacc9e on hv-cinder-80626 Sep 02 17:12:27.154286 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [req-cc4a2963-2337-4e75-b5af-60d0f0686101 req-3ce98fb0-4562-47e7-b152-84344d410ee7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043719 Sep 02 17:12:27.166754 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 347/740] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:12:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:12:27.211824 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-39f6176c-ca21-4ed8-9614-202673c77b5f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:27.223882 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-9b87cb65-8c18-487d-9e90-0bd4354ced68 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:27.225234 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-9b87cb65-8c18-487d-9e90-0bd4354ced68 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:27.228737 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-39f6176c-ca21-4ed8-9614-202673c77b5f tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 200 len: 1466 microversion: 2.1 time: 0.142087 Sep 02 17:12:27.231649 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 394/741] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:27 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 1466 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:27.240507 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9b87cb65-8c18-487d-9e90-0bd4354ced68 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:27.245680 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9b87cb65-8c18-487d-9e90-0bd4354ced68 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:27.246996 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9b87cb65-8c18-487d-9e90-0bd4354ced68 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:27.249774 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9b87cb65-8c18-487d-9e90-0bd4354ced68 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:27.453177 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-9b87cb65-8c18-487d-9e90-0bd4354ced68 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:27.461529 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-9b87cb65-8c18-487d-9e90-0bd4354ced68 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:27.463156 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-9b87cb65-8c18-487d-9e90-0bd4354ced68 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:27.464328 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-9b87cb65-8c18-487d-9e90-0bd4354ced68 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1807 microversion: 2.20 time: 0.246839 Sep 02 17:12:27.464882 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 348/742] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:27 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1807 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:12:27.737077 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-13f31059-1ffb-4fbd-a9e7-ec7b12f8c63e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:27.738499 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-13f31059-1ffb-4fbd-a9e7-ec7b12f8c63e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:27.744871 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-13f31059-1ffb-4fbd-a9e7-ec7b12f8c63e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:27.745310 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-13f31059-1ffb-4fbd-a9e7-ec7b12f8c63e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:27.746257 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-13f31059-1ffb-4fbd-a9e7-ec7b12f8c63e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:27.746770 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-13f31059-1ffb-4fbd-a9e7-ec7b12f8c63e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:27.786501 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-e5999732-4719-42a0-a2c7-d31705352b8f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:27.787628 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-e5999732-4719-42a0-a2c7-d31705352b8f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:27.793883 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e5999732-4719-42a0-a2c7-d31705352b8f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:27.794328 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e5999732-4719-42a0-a2c7-d31705352b8f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:27.795136 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e5999732-4719-42a0-a2c7-d31705352b8f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:27.795587 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e5999732-4719-42a0-a2c7-d31705352b8f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:27.873324 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-13f31059-1ffb-4fbd-a9e7-ec7b12f8c63e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:27.881149 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-13f31059-1ffb-4fbd-a9e7-ec7b12f8c63e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1267 microversion: 2.1 time: 0.147742 Sep 02 17:12:27.881902 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 395/743] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:27 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:27.895304 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-e5999732-4719-42a0-a2c7-d31705352b8f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.112333 Sep 02 17:12:27.895943 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 349/744] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:12:27 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:12:28.248879 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-42013f68-2154-42f0-b151-68c67f168d1e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:28.249490 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-42013f68-2154-42f0-b151-68c67f168d1e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: e8c6e69a-9463-455b-b782-db0bcadacc9e] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:28.255907 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-42013f68-2154-42f0-b151-68c67f168d1e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:28.256361 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-42013f68-2154-42f0-b151-68c67f168d1e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:28.257134 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-42013f68-2154-42f0-b151-68c67f168d1e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:28.257596 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-42013f68-2154-42f0-b151-68c67f168d1e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:28.271683 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.wsgi [None req-42013f68-2154-42f0-b151-68c67f168d1e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] HTTP exception thrown: Instance e8c6e69a-9463-455b-b782-db0bcadacc9e could not be found. Sep 02 17:12:28.272277 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-42013f68-2154-42f0-b151-68c67f168d1e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Returning 404 to user: Instance e8c6e69a-9463-455b-b782-db0bcadacc9e could not be found. {{(pid=108418) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:12:28.273102 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-42013f68-2154-42f0-b151-68c67f168d1e tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e" status: 404 len: 111 microversion: 2.1 time: 0.027872 Sep 02 17:12:28.273642 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 396/745] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:28 2021] GET /compute/v2.1/servers/e8c6e69a-9463-455b-b782-db0bcadacc9e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 17:12:28.282174 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-1dce31b2-8921-48f2-98b1-d068db2cb805 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:28.282786 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-1dce31b2-8921-48f2-98b1-d068db2cb805 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:28.289349 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1dce31b2-8921-48f2-98b1-d068db2cb805 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:28.289795 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1dce31b2-8921-48f2-98b1-d068db2cb805 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:28.290571 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1dce31b2-8921-48f2-98b1-d068db2cb805 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:28.291037 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1dce31b2-8921-48f2-98b1-d068db2cb805 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:28.316031 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-1dce31b2-8921-48f2-98b1-d068db2cb805 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Going to try to terminate instance {{(pid=108417) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 17:12:28.394846 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-1dce31b2-8921-48f2-98b1-d068db2cb805 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "DELETE /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 204 len: 0 microversion: 2.1 time: 0.116254 Sep 02 17:12:28.395464 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 350/746] 10.222.0.41 () {58 vars in 1239 bytes} [Thu Sep 2 17:12:28 2021] DELETE /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 17:12:28.403291 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-c46db48b-6992-448a-95c4-5d097a549506 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:28.403891 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-c46db48b-6992-448a-95c4-5d097a549506 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:28.409767 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c46db48b-6992-448a-95c4-5d097a549506 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:28.410208 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c46db48b-6992-448a-95c4-5d097a549506 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:28.410992 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c46db48b-6992-448a-95c4-5d097a549506 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:28.411424 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c46db48b-6992-448a-95c4-5d097a549506 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:28.482678 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-ea218c5c-2f24-4ec0-aac7-1b4bb9d0f603 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:28.483661 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-ea218c5c-2f24-4ec0-aac7-1b4bb9d0f603 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:28.491177 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ea218c5c-2f24-4ec0-aac7-1b4bb9d0f603 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:28.491690 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ea218c5c-2f24-4ec0-aac7-1b4bb9d0f603 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:28.492644 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ea218c5c-2f24-4ec0-aac7-1b4bb9d0f603 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:28.493297 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ea218c5c-2f24-4ec0-aac7-1b4bb9d0f603 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:28.550996 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-c46db48b-6992-448a-95c4-5d097a549506 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:28.559797 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-c46db48b-6992-448a-95c4-5d097a549506 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1522 microversion: 2.1 time: 0.160115 Sep 02 17:12:28.560364 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 397/747] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:28 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:28.634818 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-ea218c5c-2f24-4ec0-aac7-1b4bb9d0f603 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:28.643606 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-ea218c5c-2f24-4ec0-aac7-1b4bb9d0f603 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:28.645105 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-ea218c5c-2f24-4ec0-aac7-1b4bb9d0f603 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:28.646249 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-ea218c5c-2f24-4ec0-aac7-1b4bb9d0f603 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1807 microversion: 2.20 time: 0.167591 Sep 02 17:12:28.646948 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 351/748] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:28 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:12:28.897266 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-cfce3f1f-6de4-463d-87af-666bde916840 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:28.897881 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-cfce3f1f-6de4-463d-87af-666bde916840 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:28.903946 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cfce3f1f-6de4-463d-87af-666bde916840 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:28.904409 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cfce3f1f-6de4-463d-87af-666bde916840 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:28.905167 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cfce3f1f-6de4-463d-87af-666bde916840 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:28.905599 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cfce3f1f-6de4-463d-87af-666bde916840 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:28.907673 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-50887766-b076-4da0-98ed-653f101c6e90 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:28.908819 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-50887766-b076-4da0-98ed-653f101c6e90 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:28.915376 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-50887766-b076-4da0-98ed-653f101c6e90 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:28.915776 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-50887766-b076-4da0-98ed-653f101c6e90 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:28.916542 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-50887766-b076-4da0-98ed-653f101c6e90 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:28.916964 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-50887766-b076-4da0-98ed-653f101c6e90 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:29.017239 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-50887766-b076-4da0-98ed-653f101c6e90 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.114116 Sep 02 17:12:29.018012 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 352/749] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:12:28 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:12:29.032022 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-cfce3f1f-6de4-463d-87af-666bde916840 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:29.039901 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-cfce3f1f-6de4-463d-87af-666bde916840 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1267 microversion: 2.1 time: 0.146263 Sep 02 17:12:29.040448 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 398/750] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:28 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1267 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:29.579730 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-4a0daa70-86af-49ea-ba9d-0e1147aa60c7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:29.579730 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-4a0daa70-86af-49ea-ba9d-0e1147aa60c7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:29.586821 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4a0daa70-86af-49ea-ba9d-0e1147aa60c7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:29.587265 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4a0daa70-86af-49ea-ba9d-0e1147aa60c7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:29.588023 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4a0daa70-86af-49ea-ba9d-0e1147aa60c7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:29.588450 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4a0daa70-86af-49ea-ba9d-0e1147aa60c7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:29.664137 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-979025d1-b9c1-4e57-84af-0fdba6a38af9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:29.664822 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-979025d1-b9c1-4e57-84af-0fdba6a38af9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:29.671516 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-979025d1-b9c1-4e57-84af-0fdba6a38af9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:29.671963 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-979025d1-b9c1-4e57-84af-0fdba6a38af9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:29.672737 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-979025d1-b9c1-4e57-84af-0fdba6a38af9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:29.673353 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-979025d1-b9c1-4e57-84af-0fdba6a38af9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:29.724296 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-4a0daa70-86af-49ea-ba9d-0e1147aa60c7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:29.735590 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-4a0daa70-86af-49ea-ba9d-0e1147aa60c7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1522 microversion: 2.1 time: 0.160439 Sep 02 17:12:29.737042 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 353/751] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:29 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:29.812987 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-979025d1-b9c1-4e57-84af-0fdba6a38af9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:29.821318 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-979025d1-b9c1-4e57-84af-0fdba6a38af9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:29.823586 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-979025d1-b9c1-4e57-84af-0fdba6a38af9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:29.824917 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-979025d1-b9c1-4e57-84af-0fdba6a38af9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1807 microversion: 2.20 time: 0.164582 Sep 02 17:12:29.825614 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 399/752] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:29 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:12:30.029168 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-0bcbfae6-8bde-4067-b70f-ab2e05891744 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:30.030077 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-0bcbfae6-8bde-4067-b70f-ab2e05891744 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:30.036053 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0bcbfae6-8bde-4067-b70f-ab2e05891744 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:30.036597 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0bcbfae6-8bde-4067-b70f-ab2e05891744 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:30.037384 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0bcbfae6-8bde-4067-b70f-ab2e05891744 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:30.037818 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0bcbfae6-8bde-4067-b70f-ab2e05891744 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:30.061404 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-956860db-af8f-48be-9841-aa096672e03a tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:30.062016 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-956860db-af8f-48be-9841-aa096672e03a tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:30.068757 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-956860db-af8f-48be-9841-aa096672e03a tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:30.069208 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-956860db-af8f-48be-9841-aa096672e03a tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:30.069984 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-956860db-af8f-48be-9841-aa096672e03a tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:30.070416 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-956860db-af8f-48be-9841-aa096672e03a tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:30.130455 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-0bcbfae6-8bde-4067-b70f-ab2e05891744 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.104210 Sep 02 17:12:30.132369 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 354/753] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:12:30 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:12:30.204745 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-956860db-af8f-48be-9841-aa096672e03a tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:30.212515 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-956860db-af8f-48be-9841-aa096672e03a tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1267 microversion: 2.1 time: 0.158998 Sep 02 17:12:30.213262 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 400/754] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:30 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:30.755790 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-59c16025-140d-412e-879e-ced134d89f6b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:30.756693 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-59c16025-140d-412e-879e-ced134d89f6b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:30.763700 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-59c16025-140d-412e-879e-ced134d89f6b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:30.764262 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-59c16025-140d-412e-879e-ced134d89f6b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:30.765111 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-59c16025-140d-412e-879e-ced134d89f6b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:30.765613 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-59c16025-140d-412e-879e-ced134d89f6b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:30.843611 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-ea746cd3-0a00-4afd-af8e-9453c871c29b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:30.844344 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-ea746cd3-0a00-4afd-af8e-9453c871c29b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:30.851126 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ea746cd3-0a00-4afd-af8e-9453c871c29b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:30.851574 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ea746cd3-0a00-4afd-af8e-9453c871c29b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:30.852513 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ea746cd3-0a00-4afd-af8e-9453c871c29b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:30.852939 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ea746cd3-0a00-4afd-af8e-9453c871c29b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:30.960359 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-59c16025-140d-412e-879e-ced134d89f6b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:30.968071 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-59c16025-140d-412e-879e-ced134d89f6b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1522 microversion: 2.1 time: 0.218999 Sep 02 17:12:30.968653 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 355/755] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:30 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:30.978745 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-ea746cd3-0a00-4afd-af8e-9453c871c29b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:30.988103 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-ea746cd3-0a00-4afd-af8e-9453c871c29b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:30.989965 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-ea746cd3-0a00-4afd-af8e-9453c871c29b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:30.991149 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-ea746cd3-0a00-4afd-af8e-9453c871c29b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1807 microversion: 2.20 time: 0.151429 Sep 02 17:12:30.991674 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 401/756] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:30 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:12:31.144018 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-96649915-cf52-48c4-bdc8-60ca463995f2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:31.144938 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-96649915-cf52-48c4-bdc8-60ca463995f2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:31.151293 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-96649915-cf52-48c4-bdc8-60ca463995f2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:31.151741 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-96649915-cf52-48c4-bdc8-60ca463995f2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:31.152509 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-96649915-cf52-48c4-bdc8-60ca463995f2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:31.152948 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-96649915-cf52-48c4-bdc8-60ca463995f2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:31.229516 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-1f71aed3-63e3-4034-b932-9361ad6d1aca tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:31.230221 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-1f71aed3-63e3-4034-b932-9361ad6d1aca tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:31.235790 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1f71aed3-63e3-4034-b932-9361ad6d1aca tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:31.236707 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1f71aed3-63e3-4034-b932-9361ad6d1aca tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:31.238247 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1f71aed3-63e3-4034-b932-9361ad6d1aca tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:31.238247 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1f71aed3-63e3-4034-b932-9361ad6d1aca tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:31.246537 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-96649915-cf52-48c4-bdc8-60ca463995f2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.106021 Sep 02 17:12:31.250167 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 356/757] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:12:31 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:12:31.373652 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-1f71aed3-63e3-4034-b932-9361ad6d1aca tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:31.381800 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-1f71aed3-63e3-4034-b932-9361ad6d1aca tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1267 microversion: 2.1 time: 0.156155 Sep 02 17:12:31.382574 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 402/758] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:31 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:31.986125 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-f920682d-deb2-44dc-9a56-9f703eb1b67a tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:31.987135 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-f920682d-deb2-44dc-9a56-9f703eb1b67a tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:31.995754 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f920682d-deb2-44dc-9a56-9f703eb1b67a tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:31.996379 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f920682d-deb2-44dc-9a56-9f703eb1b67a tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:31.997418 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f920682d-deb2-44dc-9a56-9f703eb1b67a tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:31.997976 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f920682d-deb2-44dc-9a56-9f703eb1b67a tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:32.011256 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-225fe949-6d76-4263-9038-bb84d2b5bd58 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:32.012428 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-225fe949-6d76-4263-9038-bb84d2b5bd58 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:32.020579 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-225fe949-6d76-4263-9038-bb84d2b5bd58 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:32.021886 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-225fe949-6d76-4263-9038-bb84d2b5bd58 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:32.022923 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-225fe949-6d76-4263-9038-bb84d2b5bd58 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:32.023547 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-225fe949-6d76-4263-9038-bb84d2b5bd58 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:32.175981 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-f920682d-deb2-44dc-9a56-9f703eb1b67a tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:32.183335 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-f920682d-deb2-44dc-9a56-9f703eb1b67a tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1522 microversion: 2.1 time: 0.201668 Sep 02 17:12:32.183902 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 357/759] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:31 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:32.185639 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-225fe949-6d76-4263-9038-bb84d2b5bd58 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:32.193890 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-225fe949-6d76-4263-9038-bb84d2b5bd58 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:32.195442 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-225fe949-6d76-4263-9038-bb84d2b5bd58 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:32.196575 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-225fe949-6d76-4263-9038-bb84d2b5bd58 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1807 microversion: 2.20 time: 0.191086 Sep 02 17:12:32.197115 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 403/760] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:32 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1807 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:12:32.261305 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-93ea56fe-2966-4c90-83c0-8a00827b76c8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:32.262217 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-93ea56fe-2966-4c90-83c0-8a00827b76c8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:32.267876 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-93ea56fe-2966-4c90-83c0-8a00827b76c8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:32.268312 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-93ea56fe-2966-4c90-83c0-8a00827b76c8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:32.269061 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-93ea56fe-2966-4c90-83c0-8a00827b76c8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:32.269490 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-93ea56fe-2966-4c90-83c0-8a00827b76c8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:32.371038 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-93ea56fe-2966-4c90-83c0-8a00827b76c8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.113240 Sep 02 17:12:32.371949 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 358/761] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:12:32 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:12:32.397813 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-bf802c21-4eae-483b-adcc-b0abc3ff49f8 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:32.398439 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-bf802c21-4eae-483b-adcc-b0abc3ff49f8 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:32.404300 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bf802c21-4eae-483b-adcc-b0abc3ff49f8 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:32.404742 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bf802c21-4eae-483b-adcc-b0abc3ff49f8 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:32.405490 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bf802c21-4eae-483b-adcc-b0abc3ff49f8 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:32.405916 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bf802c21-4eae-483b-adcc-b0abc3ff49f8 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:32.523266 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-bf802c21-4eae-483b-adcc-b0abc3ff49f8 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:32.530525 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-bf802c21-4eae-483b-adcc-b0abc3ff49f8 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1267 microversion: 2.1 time: 0.136930 Sep 02 17:12:32.531109 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 404/762] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:32 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1267 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:33.200620 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-3534d7d3-c681-484f-9c71-767deae9b1c2 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:33.201303 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-3534d7d3-c681-484f-9c71-767deae9b1c2 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:33.207955 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3534d7d3-c681-484f-9c71-767deae9b1c2 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:33.208398 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3534d7d3-c681-484f-9c71-767deae9b1c2 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:33.209172 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3534d7d3-c681-484f-9c71-767deae9b1c2 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:33.209606 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3534d7d3-c681-484f-9c71-767deae9b1c2 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:33.214311 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-4c1e3fab-81b2-4b3a-9098-0afd2ad07b5e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:33.214962 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-4c1e3fab-81b2-4b3a-9098-0afd2ad07b5e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:33.220655 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4c1e3fab-81b2-4b3a-9098-0afd2ad07b5e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:33.221101 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4c1e3fab-81b2-4b3a-9098-0afd2ad07b5e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:33.221869 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4c1e3fab-81b2-4b3a-9098-0afd2ad07b5e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:33.222296 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4c1e3fab-81b2-4b3a-9098-0afd2ad07b5e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:33.334086 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-3534d7d3-c681-484f-9c71-767deae9b1c2 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:33.341601 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-3534d7d3-c681-484f-9c71-767deae9b1c2 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1522 microversion: 2.1 time: 0.145139 Sep 02 17:12:33.342173 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 359/763] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:33 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:33.346321 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-4c1e3fab-81b2-4b3a-9098-0afd2ad07b5e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:33.355391 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-4c1e3fab-81b2-4b3a-9098-0afd2ad07b5e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:33.356870 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-4c1e3fab-81b2-4b3a-9098-0afd2ad07b5e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:33.358012 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-4c1e3fab-81b2-4b3a-9098-0afd2ad07b5e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1807 microversion: 2.20 time: 0.147451 Sep 02 17:12:33.358676 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 405/764] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:33 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1807 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:12:33.382283 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-9562c02b-b71b-4910-afdc-ce1854e00cd3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:33.383237 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-9562c02b-b71b-4910-afdc-ce1854e00cd3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:33.389386 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9562c02b-b71b-4910-afdc-ce1854e00cd3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:33.389832 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9562c02b-b71b-4910-afdc-ce1854e00cd3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:33.390595 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9562c02b-b71b-4910-afdc-ce1854e00cd3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:33.391049 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9562c02b-b71b-4910-afdc-ce1854e00cd3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:33.547145 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-b8c13819-e222-4aba-b11f-84808b1b973d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:33.547747 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-b8c13819-e222-4aba-b11f-84808b1b973d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:33.554321 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b8c13819-e222-4aba-b11f-84808b1b973d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:33.554808 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b8c13819-e222-4aba-b11f-84808b1b973d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:33.555799 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b8c13819-e222-4aba-b11f-84808b1b973d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:33.556237 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b8c13819-e222-4aba-b11f-84808b1b973d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:33.697488 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-b8c13819-e222-4aba-b11f-84808b1b973d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:33.705009 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-b8c13819-e222-4aba-b11f-84808b1b973d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1267 microversion: 2.1 time: 0.161521 Sep 02 17:12:33.705565 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 406/765] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:33 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:34.358906 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-24792584-eae5-4607-8cc3-762989563704 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:34.359430 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-24792584-eae5-4607-8cc3-762989563704 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:34.366018 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-24792584-eae5-4607-8cc3-762989563704 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:34.366457 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-24792584-eae5-4607-8cc3-762989563704 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:34.367244 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-24792584-eae5-4607-8cc3-762989563704 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:34.367674 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-24792584-eae5-4607-8cc3-762989563704 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:34.487648 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-24792584-eae5-4607-8cc3-762989563704 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:34.495369 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-24792584-eae5-4607-8cc3-762989563704 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1522 microversion: 2.1 time: 0.140205 Sep 02 17:12:34.495926 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 407/766] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:34 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1522 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:34.500120 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-be8eee73-9aeb-4894-8753-7aaf2aa32c43 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:34.500716 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-be8eee73-9aeb-4894-8753-7aaf2aa32c43 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:34.507039 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-be8eee73-9aeb-4894-8753-7aaf2aa32c43 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:34.507485 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-be8eee73-9aeb-4894-8753-7aaf2aa32c43 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:34.508255 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-be8eee73-9aeb-4894-8753-7aaf2aa32c43 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:34.508684 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-be8eee73-9aeb-4894-8753-7aaf2aa32c43 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:34.631758 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-be8eee73-9aeb-4894-8753-7aaf2aa32c43 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:34.640091 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-be8eee73-9aeb-4894-8753-7aaf2aa32c43 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:34.641816 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-be8eee73-9aeb-4894-8753-7aaf2aa32c43 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:34.642990 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-be8eee73-9aeb-4894-8753-7aaf2aa32c43 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1807 microversion: 2.20 time: 0.146133 Sep 02 17:12:34.643540 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 408/767] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:34 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1807 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:12:34.724425 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-7e810937-49bb-4ae7-b110-f7ffec4aae28 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:34.725025 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-7e810937-49bb-4ae7-b110-f7ffec4aae28 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:34.731137 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7e810937-49bb-4ae7-b110-f7ffec4aae28 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:34.731688 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7e810937-49bb-4ae7-b110-f7ffec4aae28 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:34.732544 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7e810937-49bb-4ae7-b110-f7ffec4aae28 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:34.733039 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7e810937-49bb-4ae7-b110-f7ffec4aae28 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:34.852248 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-7e810937-49bb-4ae7-b110-f7ffec4aae28 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:34.859524 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-7e810937-49bb-4ae7-b110-f7ffec4aae28 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1267 microversion: 2.1 time: 0.139272 Sep 02 17:12:34.860069 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 409/768] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:34 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1267 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:35.511821 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-2c7969a0-ca7b-4d02-97d1-748e020a88b0 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:35.512333 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-2c7969a0-ca7b-4d02-97d1-748e020a88b0 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:35.518075 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2c7969a0-ca7b-4d02-97d1-748e020a88b0 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:35.518513 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2c7969a0-ca7b-4d02-97d1-748e020a88b0 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:35.519293 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2c7969a0-ca7b-4d02-97d1-748e020a88b0 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:35.519719 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2c7969a0-ca7b-4d02-97d1-748e020a88b0 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:35.638574 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-2c7969a0-ca7b-4d02-97d1-748e020a88b0 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:35.645809 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-2c7969a0-ca7b-4d02-97d1-748e020a88b0 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1522 microversion: 2.1 time: 0.137773 Sep 02 17:12:35.646357 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 410/769] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:35 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1522 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:35.661467 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-9562c02b-b71b-4910-afdc-ce1854e00cd3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 2.282246 Sep 02 17:12:35.661990 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-cd553539-c228-4efd-bddc-15f10f63d9da tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:35.662168 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 360/770] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:12:33 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 2284 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:12:35.662496 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-cd553539-c228-4efd-bddc-15f10f63d9da tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:35.668529 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cd553539-c228-4efd-bddc-15f10f63d9da tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:35.668977 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cd553539-c228-4efd-bddc-15f10f63d9da tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:35.669743 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cd553539-c228-4efd-bddc-15f10f63d9da tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:35.670172 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cd553539-c228-4efd-bddc-15f10f63d9da tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:35.797930 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-cd553539-c228-4efd-bddc-15f10f63d9da tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:35.806292 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-cd553539-c228-4efd-bddc-15f10f63d9da tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:35.807810 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-cd553539-c228-4efd-bddc-15f10f63d9da tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:35.808962 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-cd553539-c228-4efd-bddc-15f10f63d9da tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1807 microversion: 2.20 time: 0.151538 Sep 02 17:12:35.809511 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 411/771] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:35 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:12:35.877568 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-624b1e2f-212b-4bab-8090-88ac9281f2cb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:35.878249 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-624b1e2f-212b-4bab-8090-88ac9281f2cb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:35.884782 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-624b1e2f-212b-4bab-8090-88ac9281f2cb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:35.885223 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-624b1e2f-212b-4bab-8090-88ac9281f2cb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:35.885981 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-624b1e2f-212b-4bab-8090-88ac9281f2cb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:35.886405 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-624b1e2f-212b-4bab-8090-88ac9281f2cb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:36.012067 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-624b1e2f-212b-4bab-8090-88ac9281f2cb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:36.019469 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-624b1e2f-212b-4bab-8090-88ac9281f2cb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1267 microversion: 2.1 time: 0.145982 Sep 02 17:12:36.020566 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 361/772] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:35 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:36.662215 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-290bbf9e-d234-47f4-a9be-bf07aa7ede79 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:36.662889 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-290bbf9e-d234-47f4-a9be-bf07aa7ede79 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:36.669114 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-290bbf9e-d234-47f4-a9be-bf07aa7ede79 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:36.669561 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-290bbf9e-d234-47f4-a9be-bf07aa7ede79 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:36.670352 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-290bbf9e-d234-47f4-a9be-bf07aa7ede79 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:36.670819 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-290bbf9e-d234-47f4-a9be-bf07aa7ede79 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:36.672988 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-e0c34f53-9796-4823-9583-6ebb52aab1fa tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:36.673950 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-e0c34f53-9796-4823-9583-6ebb52aab1fa tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:36.680275 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e0c34f53-9796-4823-9583-6ebb52aab1fa tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:36.680721 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e0c34f53-9796-4823-9583-6ebb52aab1fa tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:36.681486 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e0c34f53-9796-4823-9583-6ebb52aab1fa tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:36.681916 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e0c34f53-9796-4823-9583-6ebb52aab1fa tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:36.792506 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-290bbf9e-d234-47f4-a9be-bf07aa7ede79 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:36.799683 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-290bbf9e-d234-47f4-a9be-bf07aa7ede79 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1522 microversion: 2.1 time: 0.141221 Sep 02 17:12:36.800230 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 412/773] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:36 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1522 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:36.826244 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-fea0d3d1-5177-4e1a-95f5-a2f2a17c48d1 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:36.826921 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-fea0d3d1-5177-4e1a-95f5-a2f2a17c48d1 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:36.832671 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fea0d3d1-5177-4e1a-95f5-a2f2a17c48d1 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:36.833115 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fea0d3d1-5177-4e1a-95f5-a2f2a17c48d1 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:36.833866 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fea0d3d1-5177-4e1a-95f5-a2f2a17c48d1 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:36.834289 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fea0d3d1-5177-4e1a-95f5-a2f2a17c48d1 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:36.956349 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-fea0d3d1-5177-4e1a-95f5-a2f2a17c48d1 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:36.965063 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-fea0d3d1-5177-4e1a-95f5-a2f2a17c48d1 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:36.966546 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-fea0d3d1-5177-4e1a-95f5-a2f2a17c48d1 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:36.967726 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-fea0d3d1-5177-4e1a-95f5-a2f2a17c48d1 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1807 microversion: 2.20 time: 0.145032 Sep 02 17:12:36.968270 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 413/774] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:36 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1807 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:12:37.036489 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-5ed9afe1-cea8-469c-bff6-f4b7e93fe9ed tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:37.037004 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-5ed9afe1-cea8-469c-bff6-f4b7e93fe9ed tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:37.042872 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5ed9afe1-cea8-469c-bff6-f4b7e93fe9ed tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:37.043310 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5ed9afe1-cea8-469c-bff6-f4b7e93fe9ed tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:37.044083 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5ed9afe1-cea8-469c-bff6-f4b7e93fe9ed tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:37.044492 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5ed9afe1-cea8-469c-bff6-f4b7e93fe9ed tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:37.165678 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-5ed9afe1-cea8-469c-bff6-f4b7e93fe9ed tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:37.172762 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-5ed9afe1-cea8-469c-bff6-f4b7e93fe9ed tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1267 microversion: 2.1 time: 0.140301 Sep 02 17:12:37.173315 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 414/775] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:37 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1267 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:37.817361 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-6ae95e70-271d-40aa-9377-21c6cc93eebe tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:37.817995 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-6ae95e70-271d-40aa-9377-21c6cc93eebe tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:37.823756 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6ae95e70-271d-40aa-9377-21c6cc93eebe tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:37.824197 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6ae95e70-271d-40aa-9377-21c6cc93eebe tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:37.824959 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6ae95e70-271d-40aa-9377-21c6cc93eebe tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:37.825391 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6ae95e70-271d-40aa-9377-21c6cc93eebe tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:37.942751 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-6ae95e70-271d-40aa-9377-21c6cc93eebe tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:37.950163 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-6ae95e70-271d-40aa-9377-21c6cc93eebe tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1522 microversion: 2.1 time: 0.136960 Sep 02 17:12:37.950734 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 415/776] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:37 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1522 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:37.985234 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-7c5e6573-7b44-4d9a-ad78-d8fdc69d832c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:37.985839 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-7c5e6573-7b44-4d9a-ad78-d8fdc69d832c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:37.992517 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7c5e6573-7b44-4d9a-ad78-d8fdc69d832c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:37.992962 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7c5e6573-7b44-4d9a-ad78-d8fdc69d832c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:37.993721 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7c5e6573-7b44-4d9a-ad78-d8fdc69d832c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:37.994160 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7c5e6573-7b44-4d9a-ad78-d8fdc69d832c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:38.111846 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-7c5e6573-7b44-4d9a-ad78-d8fdc69d832c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:38.121509 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-7c5e6573-7b44-4d9a-ad78-d8fdc69d832c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:38.123030 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-7c5e6573-7b44-4d9a-ad78-d8fdc69d832c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:38.124185 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-7c5e6573-7b44-4d9a-ad78-d8fdc69d832c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1807 microversion: 2.20 time: 0.142574 Sep 02 17:12:38.124736 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 416/777] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:37 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1807 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:12:38.189005 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-31530a4f-3476-4422-a489-9caccca58f32 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:38.189612 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-31530a4f-3476-4422-a489-9caccca58f32 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:38.196270 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-31530a4f-3476-4422-a489-9caccca58f32 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:38.196722 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-31530a4f-3476-4422-a489-9caccca58f32 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:38.197493 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-31530a4f-3476-4422-a489-9caccca58f32 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:38.197926 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-31530a4f-3476-4422-a489-9caccca58f32 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:38.319562 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-31530a4f-3476-4422-a489-9caccca58f32 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:38.326834 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-31530a4f-3476-4422-a489-9caccca58f32 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1267 microversion: 2.1 time: 0.141330 Sep 02 17:12:38.327316 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 417/778] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:38 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1267 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:38.967237 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-7665d3d6-a034-4e2b-97be-019f9bdb07f7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:38.967863 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-7665d3d6-a034-4e2b-97be-019f9bdb07f7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:38.974475 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7665d3d6-a034-4e2b-97be-019f9bdb07f7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:38.974948 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7665d3d6-a034-4e2b-97be-019f9bdb07f7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:38.975699 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7665d3d6-a034-4e2b-97be-019f9bdb07f7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:38.976128 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7665d3d6-a034-4e2b-97be-019f9bdb07f7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:39.094762 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-7665d3d6-a034-4e2b-97be-019f9bdb07f7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:39.102565 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-7665d3d6-a034-4e2b-97be-019f9bdb07f7 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1522 microversion: 2.1 time: 0.138933 Sep 02 17:12:39.103148 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 418/779] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:38 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1522 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:39.142505 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-dff07608-885f-415c-be12-b6a9a6970f9e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:39.143051 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-dff07608-885f-415c-be12-b6a9a6970f9e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:39.149588 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-dff07608-885f-415c-be12-b6a9a6970f9e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:39.150039 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-dff07608-885f-415c-be12-b6a9a6970f9e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:39.150838 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-dff07608-885f-415c-be12-b6a9a6970f9e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:39.151275 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-dff07608-885f-415c-be12-b6a9a6970f9e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:39.269247 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-dff07608-885f-415c-be12-b6a9a6970f9e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:39.277995 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-dff07608-885f-415c-be12-b6a9a6970f9e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:39.279500 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-dff07608-885f-415c-be12-b6a9a6970f9e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:39.280644 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-dff07608-885f-415c-be12-b6a9a6970f9e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1807 microversion: 2.20 time: 0.141853 Sep 02 17:12:39.281193 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 419/780] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:39 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1807 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:12:39.343424 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-d49a082f-4276-43d6-8e55-fb1d6192bb2d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:39.343956 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-d49a082f-4276-43d6-8e55-fb1d6192bb2d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:39.349870 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d49a082f-4276-43d6-8e55-fb1d6192bb2d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:39.350313 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d49a082f-4276-43d6-8e55-fb1d6192bb2d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:39.351110 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d49a082f-4276-43d6-8e55-fb1d6192bb2d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:39.351543 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d49a082f-4276-43d6-8e55-fb1d6192bb2d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:39.473970 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-d49a082f-4276-43d6-8e55-fb1d6192bb2d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:39.481289 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-d49a082f-4276-43d6-8e55-fb1d6192bb2d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1267 microversion: 2.1 time: 0.141676 Sep 02 17:12:39.481852 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 420/781] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:39 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1267 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:39.845882 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-e0c34f53-9796-4823-9583-6ebb52aab1fa tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 3.176298 Sep 02 17:12:39.846973 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 362/782] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:12:36 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 3178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:12:40.119519 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-88dc544b-3028-4d77-913d-f5e52ab881a0 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:40.120144 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-88dc544b-3028-4d77-913d-f5e52ab881a0 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:40.125945 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-88dc544b-3028-4d77-913d-f5e52ab881a0 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:40.126397 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-88dc544b-3028-4d77-913d-f5e52ab881a0 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:40.127203 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-88dc544b-3028-4d77-913d-f5e52ab881a0 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:40.127640 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-88dc544b-3028-4d77-913d-f5e52ab881a0 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:40.261828 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-88dc544b-3028-4d77-913d-f5e52ab881a0 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:40.269482 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-88dc544b-3028-4d77-913d-f5e52ab881a0 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1522 microversion: 2.1 time: 0.153830 Sep 02 17:12:40.278678 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 421/783] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:40 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:40.282069 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [req-93cc13d8-cca6-4244-98c0-1c3f042533de req-52c8eec3-63ec-4ae2-94c6-0da271f36bcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "089cf4bd-25a6-4572-a20b-99c71430e5f8", "name": "network-vif-deleted", "tag": "d0ba3007-01f9-488b-88b7-3d6c6288a03e"}]} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:40.283542 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:12:40.283542 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: warnings.warn(msg) Sep 02 17:12:40.290984 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-93cc13d8-cca6-4244-98c0-1c3f042533de req-52c8eec3-63ec-4ae2-94c6-0da271f36bcb service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:40.291418 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-93cc13d8-cca6-4244-98c0-1c3f042533de req-52c8eec3-63ec-4ae2-94c6-0da271f36bcb service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:40.298309 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-8436b723-425d-482f-ad7b-5dfa96459608 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:40.298948 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-8436b723-425d-482f-ad7b-5dfa96459608 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:40.302597 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.compute.server_external_events [req-93cc13d8-cca6-4244-98c0-1c3f042533de req-52c8eec3-63ec-4ae2-94c6-0da271f36bcb service nova] Creating event network-vif-deleted:d0ba3007-01f9-488b-88b7-3d6c6288a03e for instance 089cf4bd-25a6-4572-a20b-99c71430e5f8 on hv-cinder-80626 Sep 02 17:12:40.305753 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8436b723-425d-482f-ad7b-5dfa96459608 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:40.306207 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8436b723-425d-482f-ad7b-5dfa96459608 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:40.307008 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8436b723-425d-482f-ad7b-5dfa96459608 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:40.307442 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8436b723-425d-482f-ad7b-5dfa96459608 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:40.307649 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [req-93cc13d8-cca6-4244-98c0-1c3f042533de req-52c8eec3-63ec-4ae2-94c6-0da271f36bcb service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029267 Sep 02 17:12:40.308074 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 363/784] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:12:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:12:40.427554 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-8436b723-425d-482f-ad7b-5dfa96459608 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:40.435780 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-8436b723-425d-482f-ad7b-5dfa96459608 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:40.437254 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-8436b723-425d-482f-ad7b-5dfa96459608 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:40.438392 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-8436b723-425d-482f-ad7b-5dfa96459608 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1807 microversion: 2.20 time: 0.143732 Sep 02 17:12:40.438973 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 422/785] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:40 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1807 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:12:40.498531 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-faa8d870-dbde-4172-9a59-d0b58a52257e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:40.499294 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-faa8d870-dbde-4172-9a59-d0b58a52257e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:40.505858 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-faa8d870-dbde-4172-9a59-d0b58a52257e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:40.506298 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-faa8d870-dbde-4172-9a59-d0b58a52257e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:40.507081 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-faa8d870-dbde-4172-9a59-d0b58a52257e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:40.507515 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-faa8d870-dbde-4172-9a59-d0b58a52257e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:40.632368 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-faa8d870-dbde-4172-9a59-d0b58a52257e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:40.639801 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-faa8d870-dbde-4172-9a59-d0b58a52257e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1267 microversion: 2.1 time: 0.145161 Sep 02 17:12:40.640290 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 364/786] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:40 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1267 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:40.857479 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-a4913c31-8c0a-407e-9adc-118d52cd5e56 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:40.858482 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-a4913c31-8c0a-407e-9adc-118d52cd5e56 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:40.864779 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a4913c31-8c0a-407e-9adc-118d52cd5e56 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:40.865223 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a4913c31-8c0a-407e-9adc-118d52cd5e56 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:40.866046 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a4913c31-8c0a-407e-9adc-118d52cd5e56 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:40.866473 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a4913c31-8c0a-407e-9adc-118d52cd5e56 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:41.286096 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-2a7a235f-e3c3-44d3-a87f-6910a1c2acac tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:41.286822 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-2a7a235f-e3c3-44d3-a87f-6910a1c2acac tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:41.293174 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2a7a235f-e3c3-44d3-a87f-6910a1c2acac tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:41.293871 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2a7a235f-e3c3-44d3-a87f-6910a1c2acac tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:41.294741 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2a7a235f-e3c3-44d3-a87f-6910a1c2acac tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:41.295183 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2a7a235f-e3c3-44d3-a87f-6910a1c2acac tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:41.354298 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-2a7a235f-e3c3-44d3-a87f-6910a1c2acac tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:41.361739 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-2a7a235f-e3c3-44d3-a87f-6910a1c2acac tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1480 microversion: 2.1 time: 0.079513 Sep 02 17:12:41.362299 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 365/787] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:41 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1480 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:41.456950 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-2608e213-2ea0-4061-8d29-d77d66fc252a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:41.457555 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-2608e213-2ea0-4061-8d29-d77d66fc252a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:41.463588 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2608e213-2ea0-4061-8d29-d77d66fc252a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:41.464037 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2608e213-2ea0-4061-8d29-d77d66fc252a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:41.464805 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2608e213-2ea0-4061-8d29-d77d66fc252a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:41.465240 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2608e213-2ea0-4061-8d29-d77d66fc252a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:41.582506 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-2608e213-2ea0-4061-8d29-d77d66fc252a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:41.591191 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-2608e213-2ea0-4061-8d29-d77d66fc252a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:41.592927 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-2608e213-2ea0-4061-8d29-d77d66fc252a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:41.593837 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-2608e213-2ea0-4061-8d29-d77d66fc252a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1807 microversion: 2.20 time: 0.140595 Sep 02 17:12:41.594393 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 366/788] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:41 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1807 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:12:41.656323 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-1da78a25-fed8-4419-8ad9-66bc53119473 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:41.656931 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-1da78a25-fed8-4419-8ad9-66bc53119473 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:41.663410 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1da78a25-fed8-4419-8ad9-66bc53119473 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:41.663858 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1da78a25-fed8-4419-8ad9-66bc53119473 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:41.664620 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1da78a25-fed8-4419-8ad9-66bc53119473 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:41.665060 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1da78a25-fed8-4419-8ad9-66bc53119473 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:41.787291 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-1da78a25-fed8-4419-8ad9-66bc53119473 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:41.794472 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-1da78a25-fed8-4419-8ad9-66bc53119473 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1267 microversion: 2.1 time: 0.141871 Sep 02 17:12:41.795070 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 367/789] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:41 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1267 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:42.378565 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-b9e193ec-0322-49e3-ad17-076f2b27cf0b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:42.379782 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-b9e193ec-0322-49e3-ad17-076f2b27cf0b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:42.385862 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b9e193ec-0322-49e3-ad17-076f2b27cf0b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:42.386301 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b9e193ec-0322-49e3-ad17-076f2b27cf0b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:42.387095 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b9e193ec-0322-49e3-ad17-076f2b27cf0b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:42.387523 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b9e193ec-0322-49e3-ad17-076f2b27cf0b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:42.448334 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-b9e193ec-0322-49e3-ad17-076f2b27cf0b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:42.455801 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-b9e193ec-0322-49e3-ad17-076f2b27cf0b tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1307 microversion: 2.1 time: 0.080860 Sep 02 17:12:42.456355 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 368/790] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:42 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1307 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:42.611496 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-70afb515-fba3-4769-be8e-b4c85daed188 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:42.612101 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-70afb515-fba3-4769-be8e-b4c85daed188 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:42.618583 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-70afb515-fba3-4769-be8e-b4c85daed188 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:42.619062 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-70afb515-fba3-4769-be8e-b4c85daed188 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:42.619838 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-70afb515-fba3-4769-be8e-b4c85daed188 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:42.620275 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-70afb515-fba3-4769-be8e-b4c85daed188 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:42.737912 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-70afb515-fba3-4769-be8e-b4c85daed188 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:42.746155 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-70afb515-fba3-4769-be8e-b4c85daed188 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:42.747660 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-70afb515-fba3-4769-be8e-b4c85daed188 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:42.748812 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-70afb515-fba3-4769-be8e-b4c85daed188 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1807 microversion: 2.20 time: 0.141059 Sep 02 17:12:42.749364 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 369/791] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:42 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1807 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:12:42.811011 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-24cca9e0-5f77-4784-b3ec-158020484149 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:42.811612 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-24cca9e0-5f77-4784-b3ec-158020484149 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:42.817509 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-24cca9e0-5f77-4784-b3ec-158020484149 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:42.817950 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-24cca9e0-5f77-4784-b3ec-158020484149 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:42.818729 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-24cca9e0-5f77-4784-b3ec-158020484149 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:42.819161 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-24cca9e0-5f77-4784-b3ec-158020484149 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:42.942239 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-24cca9e0-5f77-4784-b3ec-158020484149 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:42.949522 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-24cca9e0-5f77-4784-b3ec-158020484149 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1267 microversion: 2.1 time: 0.142222 Sep 02 17:12:42.950084 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 370/792] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:42 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1267 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:43.176100 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-a4913c31-8c0a-407e-9adc-118d52cd5e56 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 2.321921 Sep 02 17:12:43.178834 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 423/793] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:12:40 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 2326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:12:43.447336 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [req-d5c643bf-2115-4e1d-bb12-e6f7133af61a req-a6255b10-2a92-490d-a122-5470fa21111a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e92c68a-a864-4562-b08b-d244394268ce", "name": "network-vif-plugged", "status": "completed", "tag": "0a87c875-7882-47c2-a092-e14ea53f2b64"}]} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:43.448908 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:12:43.448908 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: warnings.warn(msg) Sep 02 17:12:43.458922 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-d5c643bf-2115-4e1d-bb12-e6f7133af61a req-a6255b10-2a92-490d-a122-5470fa21111a service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:43.459369 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-d5c643bf-2115-4e1d-bb12-e6f7133af61a req-a6255b10-2a92-490d-a122-5470fa21111a service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:43.476052 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.compute.server_external_events [req-d5c643bf-2115-4e1d-bb12-e6f7133af61a req-a6255b10-2a92-490d-a122-5470fa21111a service nova] Creating event network-vif-plugged:0a87c875-7882-47c2-a092-e14ea53f2b64 for instance 4e92c68a-a864-4562-b08b-d244394268ce on hv-cinder-80626 Sep 02 17:12:43.477134 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-893f1247-114f-4762-a245-cff69f262f99 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:43.478064 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-893f1247-114f-4762-a245-cff69f262f99 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:43.482869 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [req-d5c643bf-2115-4e1d-bb12-e6f7133af61a req-a6255b10-2a92-490d-a122-5470fa21111a service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039129 Sep 02 17:12:43.483730 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 371/794] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:12:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:12:43.486424 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-893f1247-114f-4762-a245-cff69f262f99 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:43.486988 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-893f1247-114f-4762-a245-cff69f262f99 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:43.488187 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-893f1247-114f-4762-a245-cff69f262f99 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:43.489186 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-893f1247-114f-4762-a245-cff69f262f99 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:43.527839 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-893f1247-114f-4762-a245-cff69f262f99 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:43.528546 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-893f1247-114f-4762-a245-cff69f262f99 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:43.529984 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.objects.instance [None req-893f1247-114f-4762-a245-cff69f262f99 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lazy-loading 'fault' on Instance uuid 089cf4bd-25a6-4572-a20b-99c71430e5f8 {{(pid=108418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 17:12:43.595676 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-893f1247-114f-4762-a245-cff69f262f99 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0f507b360843a7a853478c0cf360fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d00b04201ec4d46956d03ebddbef781', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:43.605720 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-893f1247-114f-4762-a245-cff69f262f99 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 200 len: 1312 microversion: 2.1 time: 0.135393 Sep 02 17:12:43.606839 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 424/795] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:43 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 1312 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:43.767746 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-da0e848f-c3d1-4c37-925d-8d99ca2e417e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:43.768514 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-da0e848f-c3d1-4c37-925d-8d99ca2e417e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:43.775446 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-da0e848f-c3d1-4c37-925d-8d99ca2e417e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:43.776215 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-da0e848f-c3d1-4c37-925d-8d99ca2e417e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:43.777053 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-da0e848f-c3d1-4c37-925d-8d99ca2e417e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:43.777485 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-da0e848f-c3d1-4c37-925d-8d99ca2e417e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:43.918256 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-da0e848f-c3d1-4c37-925d-8d99ca2e417e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:43.927424 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-da0e848f-c3d1-4c37-925d-8d99ca2e417e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:43.928976 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-da0e848f-c3d1-4c37-925d-8d99ca2e417e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:43.930149 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-da0e848f-c3d1-4c37-925d-8d99ca2e417e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1807 microversion: 2.20 time: 0.167010 Sep 02 17:12:43.930725 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 372/796] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:43 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:12:43.966468 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-47de9e7f-d3e8-4fb9-b4c1-49d3fd5de125 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:43.967094 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-47de9e7f-d3e8-4fb9-b4c1-49d3fd5de125 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:43.973379 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-47de9e7f-d3e8-4fb9-b4c1-49d3fd5de125 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:43.973814 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-47de9e7f-d3e8-4fb9-b4c1-49d3fd5de125 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:43.974665 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-47de9e7f-d3e8-4fb9-b4c1-49d3fd5de125 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:43.975117 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-47de9e7f-d3e8-4fb9-b4c1-49d3fd5de125 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:44.108275 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-47de9e7f-d3e8-4fb9-b4c1-49d3fd5de125 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:44.116497 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-47de9e7f-d3e8-4fb9-b4c1-49d3fd5de125 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1267 microversion: 2.1 time: 0.153709 Sep 02 17:12:44.117052 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 425/797] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:43 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:44.189364 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-61c26dfb-dad0-451e-b14a-3fd29fe514d1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:44.190279 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-61c26dfb-dad0-451e-b14a-3fd29fe514d1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:44.196769 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-61c26dfb-dad0-451e-b14a-3fd29fe514d1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:44.197212 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-61c26dfb-dad0-451e-b14a-3fd29fe514d1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:44.197977 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-61c26dfb-dad0-451e-b14a-3fd29fe514d1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:44.198410 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-61c26dfb-dad0-451e-b14a-3fd29fe514d1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:44.624440 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-638ce837-c040-4dfe-a0aa-e2b43d27d383 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:44.625055 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-638ce837-c040-4dfe-a0aa-e2b43d27d383 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] [instance: 089cf4bd-25a6-4572-a20b-99c71430e5f8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:44.631439 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-638ce837-c040-4dfe-a0aa-e2b43d27d383 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:44.631939 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-638ce837-c040-4dfe-a0aa-e2b43d27d383 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:44.632842 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-638ce837-c040-4dfe-a0aa-e2b43d27d383 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:44.633283 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-638ce837-c040-4dfe-a0aa-e2b43d27d383 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:44.647207 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.wsgi [None req-638ce837-c040-4dfe-a0aa-e2b43d27d383 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] HTTP exception thrown: Instance 089cf4bd-25a6-4572-a20b-99c71430e5f8 could not be found. Sep 02 17:12:44.647909 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-638ce837-c040-4dfe-a0aa-e2b43d27d383 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] Returning 404 to user: Instance 089cf4bd-25a6-4572-a20b-99c71430e5f8 could not be found. {{(pid=108418) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:12:44.648743 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-638ce837-c040-4dfe-a0aa-e2b43d27d383 tempest-ServerRescueNegativeTestJSON-435245371 tempest-ServerRescueNegativeTestJSON-435245371-project] 10.222.0.41 "GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8" status: 404 len: 111 microversion: 2.1 time: 0.028925 Sep 02 17:12:44.649286 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 426/798] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:44 2021] GET /compute/v2.1/servers/089cf4bd-25a6-4572-a20b-99c71430e5f8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 17:12:44.948297 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-b687a257-7ade-4f0c-bdc8-56198293ea2e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:44.948932 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-b687a257-7ade-4f0c-bdc8-56198293ea2e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:44.954617 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b687a257-7ade-4f0c-bdc8-56198293ea2e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:44.955094 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b687a257-7ade-4f0c-bdc8-56198293ea2e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:44.955859 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b687a257-7ade-4f0c-bdc8-56198293ea2e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:44.956292 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b687a257-7ade-4f0c-bdc8-56198293ea2e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:45.079259 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-b687a257-7ade-4f0c-bdc8-56198293ea2e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:45.088243 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-b687a257-7ade-4f0c-bdc8-56198293ea2e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:45.089747 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-b687a257-7ade-4f0c-bdc8-56198293ea2e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:45.090917 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-b687a257-7ade-4f0c-bdc8-56198293ea2e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1807 microversion: 2.20 time: 0.146518 Sep 02 17:12:45.091461 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 427/799] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:44 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1807 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:12:45.133245 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-41b083d5-bd71-4d37-b1c4-225cddf110b4 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:45.133843 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-41b083d5-bd71-4d37-b1c4-225cddf110b4 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:45.139796 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-41b083d5-bd71-4d37-b1c4-225cddf110b4 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:45.140147 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-41b083d5-bd71-4d37-b1c4-225cddf110b4 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:45.140909 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-41b083d5-bd71-4d37-b1c4-225cddf110b4 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:45.141335 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-41b083d5-bd71-4d37-b1c4-225cddf110b4 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:45.265914 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-41b083d5-bd71-4d37-b1c4-225cddf110b4 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:45.273911 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-41b083d5-bd71-4d37-b1c4-225cddf110b4 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1267 microversion: 2.1 time: 0.144840 Sep 02 17:12:45.274475 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 428/800] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:45 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1267 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:46.109453 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-b723f384-2a0f-40e9-86a1-368c13e0f222 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:46.110144 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-b723f384-2a0f-40e9-86a1-368c13e0f222 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:46.116328 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b723f384-2a0f-40e9-86a1-368c13e0f222 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:46.116783 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b723f384-2a0f-40e9-86a1-368c13e0f222 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:46.117555 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b723f384-2a0f-40e9-86a1-368c13e0f222 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:46.117991 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b723f384-2a0f-40e9-86a1-368c13e0f222 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:46.241485 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-b723f384-2a0f-40e9-86a1-368c13e0f222 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:46.249922 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-b723f384-2a0f-40e9-86a1-368c13e0f222 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:46.251431 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-b723f384-2a0f-40e9-86a1-368c13e0f222 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:46.252588 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-b723f384-2a0f-40e9-86a1-368c13e0f222 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1807 microversion: 2.20 time: 0.146982 Sep 02 17:12:46.253129 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 429/801] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:46 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1807 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:12:46.290567 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-0d8614b3-b732-45e0-b90c-d778bb5aa08d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:46.291233 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-0d8614b3-b732-45e0-b90c-d778bb5aa08d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:46.298452 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-0d8614b3-b732-45e0-b90c-d778bb5aa08d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:46.298932 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-0d8614b3-b732-45e0-b90c-d778bb5aa08d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:46.299703 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-0d8614b3-b732-45e0-b90c-d778bb5aa08d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:46.300137 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-0d8614b3-b732-45e0-b90c-d778bb5aa08d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:46.432241 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-0d8614b3-b732-45e0-b90c-d778bb5aa08d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:46.440225 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-0d8614b3-b732-45e0-b90c-d778bb5aa08d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1267 microversion: 2.1 time: 0.153266 Sep 02 17:12:46.440820 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 430/802] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:46 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:47.271549 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-3e881072-75d4-4a70-81f7-ab60cb472d27 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:47.272322 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-3e881072-75d4-4a70-81f7-ab60cb472d27 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:47.279138 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3e881072-75d4-4a70-81f7-ab60cb472d27 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:47.279615 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3e881072-75d4-4a70-81f7-ab60cb472d27 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:47.280393 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3e881072-75d4-4a70-81f7-ab60cb472d27 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:47.280825 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3e881072-75d4-4a70-81f7-ab60cb472d27 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:47.427823 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-3e881072-75d4-4a70-81f7-ab60cb472d27 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:47.447281 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-3e881072-75d4-4a70-81f7-ab60cb472d27 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:47.449196 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-3e881072-75d4-4a70-81f7-ab60cb472d27 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:47.450436 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-3e881072-75d4-4a70-81f7-ab60cb472d27 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1807 microversion: 2.20 time: 0.183607 Sep 02 17:12:47.451178 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 431/803] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:47 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1807 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:12:47.468823 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-61c26dfb-dad0-451e-b14a-3fd29fe514d1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 3.282838 Sep 02 17:12:47.470283 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 373/804] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:12:44 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 3285 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:12:47.475943 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-99f16622-4208-45bf-a562-0f97f8e1666a tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:47.476673 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-99f16622-4208-45bf-a562-0f97f8e1666a tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:47.482858 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-99f16622-4208-45bf-a562-0f97f8e1666a tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:47.483388 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-99f16622-4208-45bf-a562-0f97f8e1666a tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:47.484256 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-99f16622-4208-45bf-a562-0f97f8e1666a tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:47.484760 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-99f16622-4208-45bf-a562-0f97f8e1666a tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:47.606387 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-99f16622-4208-45bf-a562-0f97f8e1666a tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:47.613984 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-99f16622-4208-45bf-a562-0f97f8e1666a tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1267 microversion: 2.1 time: 0.141668 Sep 02 17:12:47.614549 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 432/805] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:47 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1267 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:47.844142 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-296fce43-75c5-4981-9e44-7d2985eae0f8 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:47.844742 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-296fce43-75c5-4981-9e44-7d2985eae0f8 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 39f237e0-63e9-4871-9dd5-ab033d35ae67] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:47.851245 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-296fce43-75c5-4981-9e44-7d2985eae0f8 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:47.851709 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-296fce43-75c5-4981-9e44-7d2985eae0f8 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:47.852474 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-296fce43-75c5-4981-9e44-7d2985eae0f8 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:47.852900 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-296fce43-75c5-4981-9e44-7d2985eae0f8 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:47.953791 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.objects.instance [None req-296fce43-75c5-4981-9e44-7d2985eae0f8 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lazy-loading 'services' on Instance uuid 39f237e0-63e9-4871-9dd5-ab033d35ae67 {{(pid=108417) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 17:12:48.033250 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-296fce43-75c5-4981-9e44-7d2985eae0f8 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "DELETE /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67/os-volume_attachments/1a26f825-ade3-42bc-a74d-2b8c5041779a" status: 202 len: 0 microversion: 2.1 time: 0.193107 Sep 02 17:12:48.037644 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 374/806] 10.222.0.41 () {58 vars in 1416 bytes} [Thu Sep 2 17:12:47 2021] DELETE /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67/os-volume_attachments/1a26f825-ade3-42bc-a74d-2b8c5041779a => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:12:48.474253 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-c6255ce8-4d69-4c37-a5b0-63d31c675b14 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:48.475203 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-c6255ce8-4d69-4c37-a5b0-63d31c675b14 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:48.484071 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-9535ec12-75f2-4a79-97ec-c355e0b9096e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:48.491963 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-9535ec12-75f2-4a79-97ec-c355e0b9096e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:48.494076 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c6255ce8-4d69-4c37-a5b0-63d31c675b14 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:48.497259 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c6255ce8-4d69-4c37-a5b0-63d31c675b14 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:48.499217 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c6255ce8-4d69-4c37-a5b0-63d31c675b14 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:48.501040 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c6255ce8-4d69-4c37-a5b0-63d31c675b14 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:48.504512 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9535ec12-75f2-4a79-97ec-c355e0b9096e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:48.504966 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9535ec12-75f2-4a79-97ec-c355e0b9096e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:48.505752 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9535ec12-75f2-4a79-97ec-c355e0b9096e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:48.506188 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9535ec12-75f2-4a79-97ec-c355e0b9096e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:48.624994 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-9535ec12-75f2-4a79-97ec-c355e0b9096e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.145382 Sep 02 17:12:48.625661 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 375/807] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:12:48 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:12:48.635991 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-fff5fefb-0e9b-4a59-b220-0e393efd014e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:48.635991 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-fff5fefb-0e9b-4a59-b220-0e393efd014e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:48.651879 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fff5fefb-0e9b-4a59-b220-0e393efd014e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:48.652433 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fff5fefb-0e9b-4a59-b220-0e393efd014e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:48.653262 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fff5fefb-0e9b-4a59-b220-0e393efd014e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:48.653708 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fff5fefb-0e9b-4a59-b220-0e393efd014e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:48.664705 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-c6255ce8-4d69-4c37-a5b0-63d31c675b14 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:48.680697 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-c6255ce8-4d69-4c37-a5b0-63d31c675b14 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:48.682498 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-c6255ce8-4d69-4c37-a5b0-63d31c675b14 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:48.695638 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-c6255ce8-4d69-4c37-a5b0-63d31c675b14 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1807 microversion: 2.20 time: 0.226516 Sep 02 17:12:48.696900 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 433/808] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:48 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1807 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:12:48.892537 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-fff5fefb-0e9b-4a59-b220-0e393efd014e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:48.901113 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-fff5fefb-0e9b-4a59-b220-0e393efd014e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1267 microversion: 2.1 time: 0.270268 Sep 02 17:12:48.901690 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 376/809] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:48 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1267 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:49.306245 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-0e5220a0-6ffd-41fa-ae2e-a80d0a687e43 tempest-VolumesNegativeTest-1845268695 tempest-VolumesNegativeTest-1845268695-project] Action: 'create', calling method: .version_select at 0x7fca986471f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1568291222", "metadata": {"Type": "work"}}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:49.308127 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-0e5220a0-6ffd-41fa-ae2e-a80d0a687e43 tempest-VolumesNegativeTest-1845268695 tempest-VolumesNegativeTest-1845268695-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=108418) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:12:49.309144 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-0e5220a0-6ffd-41fa-ae2e-a80d0a687e43 tempest-VolumesNegativeTest-1845268695 tempest-VolumesNegativeTest-1845268695-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.289596 Sep 02 17:12:49.309834 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 434/810] 10.222.0.41 () {60 vars in 1156 bytes} [Thu Sep 2 17:12:49 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 291 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 02 17:12:49.320645 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-6e56ac41-b725-4622-970b-c02de80249ab tempest-VolumesNegativeTest-1845268695 tempest-VolumesNegativeTest-1845268695-project] Action: 'create', calling method: .version_select at 0x7fca98502d30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1142992459", "metadata": {"Type": "work"}}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:49.322287 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-6e56ac41-b725-4622-970b-c02de80249ab tempest-VolumesNegativeTest-1845268695 tempest-VolumesNegativeTest-1845268695-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=108417) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:12:49.323344 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-6e56ac41-b725-4622-970b-c02de80249ab tempest-VolumesNegativeTest-1845268695 tempest-VolumesNegativeTest-1845268695-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.007641 Sep 02 17:12:49.324057 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 377/811] 10.222.0.41 () {60 vars in 1156 bytes} [Thu Sep 2 17:12:49 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 17:12:49.336552 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-c107db21-ce91-4431-b383-3641c297a81b tempest-VolumesNegativeTest-1845268695 tempest-VolumesNegativeTest-1845268695-project] Action: 'create', calling method: .version_select at 0x7fca984de280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1335964202", "metadata": {"Type": "work"}}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:49.339035 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-c107db21-ce91-4431-b383-3641c297a81b tempest-VolumesNegativeTest-1845268695 tempest-VolumesNegativeTest-1845268695-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=108418) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:12:49.340844 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-c107db21-ce91-4431-b383-3641c297a81b tempest-VolumesNegativeTest-1845268695 tempest-VolumesNegativeTest-1845268695-project] 10.222.0.41 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007913 Sep 02 17:12:49.342151 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 435/812] 10.222.0.41 () {60 vars in 1156 bytes} [Thu Sep 2 17:12:49 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 02 17:12:49.354614 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-3873fcf4-ff0d-46a1-b187-9e33fea3f97d tempest-VolumesNegativeTest-1845268695 tempest-VolumesNegativeTest-1845268695-project] Calling method '.version_select at 0x7fca98538d30>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:49.371369 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-cf353611-2623-4960-800f-ad11c540d88b req-55ba791e-c50a-4ff8-98c1-e68245240314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34e36f29-2bc8-4586-8de2-3a218984c046", "name": "network-vif-plugged", "status": "completed", "tag": "1af31c9b-4bff-4dc7-8b17-98d43795b25a"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:49.373372 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:12:49.373372 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:12:49.383832 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-cf353611-2623-4960-800f-ad11c540d88b req-55ba791e-c50a-4ff8-98c1-e68245240314 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:49.384569 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-cf353611-2623-4960-800f-ad11c540d88b req-55ba791e-c50a-4ff8-98c1-e68245240314 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:49.396637 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-cf353611-2623-4960-800f-ad11c540d88b req-55ba791e-c50a-4ff8-98c1-e68245240314 service nova] Creating event network-vif-plugged:1af31c9b-4bff-4dc7-8b17-98d43795b25a for instance 34e36f29-2bc8-4586-8de2-3a218984c046 on hv-cinder-80626 Sep 02 17:12:49.401441 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.wsgi [None req-3873fcf4-ff0d-46a1-b187-9e33fea3f97d tempest-VolumesNegativeTest-1845268695 tempest-VolumesNegativeTest-1845268695-project] HTTP exception thrown: Volume tempest-invalid-1799700696 could not be found. Sep 02 17:12:49.402341 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-3873fcf4-ff0d-46a1-b187-9e33fea3f97d tempest-VolumesNegativeTest-1845268695 tempest-VolumesNegativeTest-1845268695-project] Returning 404 to user: Volume tempest-invalid-1799700696 could not be found. {{(pid=108417) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:12:49.403439 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-3873fcf4-ff0d-46a1-b187-9e33fea3f97d tempest-VolumesNegativeTest-1845268695 tempest-VolumesNegativeTest-1845268695-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1799700696" status: 404 len: 99 microversion: 2.1 time: 0.056102 Sep 02 17:12:49.404456 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 378/813] 10.222.0.41 () {58 vars in 1218 bytes} [Thu Sep 2 17:12:49 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1799700696 => generated 99 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 02 17:12:49.413324 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-051412fb-754a-4c05-ab25-b579d2f60380 tempest-VolumesNegativeTest-1845268695 tempest-VolumesNegativeTest-1845268695-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003603 Sep 02 17:12:49.414223 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 379/814] 10.222.0.41 () {58 vars in 1140 bytes} [Thu Sep 2 17:12:49 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 02 17:12:49.414741 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-cf353611-2623-4960-800f-ad11c540d88b req-55ba791e-c50a-4ff8-98c1-e68245240314 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046453 Sep 02 17:12:49.415555 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 436/815] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:12:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:12:49.423418 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-cf2de122-5a86-445b-a73c-22d47dd8a709 tempest-VolumesNegativeTest-1845268695 tempest-VolumesNegativeTest-1845268695-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004062 Sep 02 17:12:49.424005 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 380/816] 10.222.0.41 () {58 vars in 1137 bytes} [Thu Sep 2 17:12:49 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 02 17:12:49.434163 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-6e96d45b-047d-4380-9a74-3bebaef17032 tempest-VolumesNegativeTest-1845268695 tempest-VolumesNegativeTest-1845268695-project] Calling method '.version_select at 0x7fca98505550>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:49.467328 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.wsgi [None req-6e96d45b-047d-4380-9a74-3bebaef17032 tempest-VolumesNegativeTest-1845268695 tempest-VolumesNegativeTest-1845268695-project] HTTP exception thrown: Volume c851a1a4-d303-4218-a833-4d941c2d19d3 could not be found. Sep 02 17:12:49.467531 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-6e96d45b-047d-4380-9a74-3bebaef17032 tempest-VolumesNegativeTest-1845268695 tempest-VolumesNegativeTest-1845268695-project] Returning 404 to user: Volume c851a1a4-d303-4218-a833-4d941c2d19d3 could not be found. {{(pid=108418) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:12:49.468412 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-6e96d45b-047d-4380-9a74-3bebaef17032 tempest-VolumesNegativeTest-1845268695 tempest-VolumesNegativeTest-1845268695-project] 10.222.0.41 "DELETE /compute/v2.1/os-volumes/c851a1a4-d303-4218-a833-4d941c2d19d3" status: 404 len: 109 microversion: 2.1 time: 0.038416 Sep 02 17:12:49.470813 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 437/817] 10.222.0.41 () {58 vars in 1248 bytes} [Thu Sep 2 17:12:49 2021] DELETE /compute/v2.1/os-volumes/c851a1a4-d303-4218-a833-4d941c2d19d3 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 17:12:49.478603 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-7ef64cdb-27c0-4b9a-9785-9582a165d1db tempest-VolumesNegativeTest-1845268695 tempest-VolumesNegativeTest-1845268695-project] Calling method '.version_select at 0x7fca98fdc550>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:49.507414 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.wsgi [None req-7ef64cdb-27c0-4b9a-9785-9582a165d1db tempest-VolumesNegativeTest-1845268695 tempest-VolumesNegativeTest-1845268695-project] HTTP exception thrown: Volume 364a589c-5a71-4d99-a720-336e7458d5c7 could not be found. Sep 02 17:12:49.508275 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-7ef64cdb-27c0-4b9a-9785-9582a165d1db tempest-VolumesNegativeTest-1845268695 tempest-VolumesNegativeTest-1845268695-project] Returning 404 to user: Volume 364a589c-5a71-4d99-a720-336e7458d5c7 could not be found. {{(pid=108417) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:12:49.509265 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-7ef64cdb-27c0-4b9a-9785-9582a165d1db tempest-VolumesNegativeTest-1845268695 tempest-VolumesNegativeTest-1845268695-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/364a589c-5a71-4d99-a720-336e7458d5c7" status: 404 len: 109 microversion: 2.1 time: 0.034803 Sep 02 17:12:49.510252 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 381/818] 10.222.0.41 () {58 vars in 1245 bytes} [Thu Sep 2 17:12:49 2021] GET /compute/v2.1/os-volumes/364a589c-5a71-4d99-a720-336e7458d5c7 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 17:12:49.641069 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-2e6456a8-67d3-454a-8bda-0f2c2b4d9157 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:49.642224 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-2e6456a8-67d3-454a-8bda-0f2c2b4d9157 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:49.650055 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2e6456a8-67d3-454a-8bda-0f2c2b4d9157 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:49.650767 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2e6456a8-67d3-454a-8bda-0f2c2b4d9157 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:49.651669 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2e6456a8-67d3-454a-8bda-0f2c2b4d9157 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:49.652290 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2e6456a8-67d3-454a-8bda-0f2c2b4d9157 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:49.718574 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-cef81d1a-982e-4c68-85a1-6c1bd70251e0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:49.720156 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-cef81d1a-982e-4c68-85a1-6c1bd70251e0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:49.733049 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-cef81d1a-982e-4c68-85a1-6c1bd70251e0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:49.733479 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-cef81d1a-982e-4c68-85a1-6c1bd70251e0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:49.734591 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-cef81d1a-982e-4c68-85a1-6c1bd70251e0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:49.735044 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-cef81d1a-982e-4c68-85a1-6c1bd70251e0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:49.796740 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-2e6456a8-67d3-454a-8bda-0f2c2b4d9157 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.162244 Sep 02 17:12:49.797895 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 438/819] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:12:49 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:12:49.874587 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-cef81d1a-982e-4c68-85a1-6c1bd70251e0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:49.883627 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-cef81d1a-982e-4c68-85a1-6c1bd70251e0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:49.885273 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-cef81d1a-982e-4c68-85a1-6c1bd70251e0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:49.886448 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-cef81d1a-982e-4c68-85a1-6c1bd70251e0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1794 microversion: 2.20 time: 0.174412 Sep 02 17:12:49.887330 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 382/820] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:12:49 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1794 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:12:49.919461 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-367fdf84-fd7b-4028-884a-36f7c19a9405 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:49.920462 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-367fdf84-fd7b-4028-884a-36f7c19a9405 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:49.927538 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-367fdf84-fd7b-4028-884a-36f7c19a9405 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:49.928089 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-367fdf84-fd7b-4028-884a-36f7c19a9405 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:49.928898 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-367fdf84-fd7b-4028-884a-36f7c19a9405 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:49.929338 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-367fdf84-fd7b-4028-884a-36f7c19a9405 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:50.071123 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-367fdf84-fd7b-4028-884a-36f7c19a9405 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:50.078869 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-367fdf84-fd7b-4028-884a-36f7c19a9405 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1267 microversion: 2.1 time: 0.163774 Sep 02 17:12:50.079434 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 439/821] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:49 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:50.287633 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-8878f9d6-5f1c-4567-8858-d9d956e75a4c tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:50.288126 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-8878f9d6-5f1c-4567-8858-d9d956e75a4c tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 39f237e0-63e9-4871-9dd5-ab033d35ae67] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:50.302706 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8878f9d6-5f1c-4567-8858-d9d956e75a4c tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:50.303362 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8878f9d6-5f1c-4567-8858-d9d956e75a4c tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:50.304088 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8878f9d6-5f1c-4567-8858-d9d956e75a4c tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:50.304451 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8878f9d6-5f1c-4567-8858-d9d956e75a4c tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:50.331381 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-8878f9d6-5f1c-4567-8858-d9d956e75a4c tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 39f237e0-63e9-4871-9dd5-ab033d35ae67] Going to try to terminate instance {{(pid=108417) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 17:12:50.408262 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-8878f9d6-5f1c-4567-8858-d9d956e75a4c tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "DELETE /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67" status: 204 len: 0 microversion: 2.1 time: 0.124705 Sep 02 17:12:50.408952 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 383/822] 10.222.0.41 () {58 vars in 1239 bytes} [Thu Sep 2 17:12:50 2021] DELETE /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 17:12:50.417270 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-9eee301b-484d-426f-9904-f12b1c417fab tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:50.417927 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-9eee301b-484d-426f-9904-f12b1c417fab tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 39f237e0-63e9-4871-9dd5-ab033d35ae67] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:50.423854 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9eee301b-484d-426f-9904-f12b1c417fab tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:50.424297 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9eee301b-484d-426f-9904-f12b1c417fab tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:50.425054 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9eee301b-484d-426f-9904-f12b1c417fab tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:50.425486 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9eee301b-484d-426f-9904-f12b1c417fab tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:50.550189 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-9eee301b-484d-426f-9904-f12b1c417fab tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:50.556043 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-9eee301b-484d-426f-9904-f12b1c417fab tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67" status: 200 len: 1511 microversion: 2.1 time: 0.142559 Sep 02 17:12:50.556676 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 440/823] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:50 2021] GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67 => generated 1511 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:50.810381 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-ed33d115-0dde-4818-b89e-b1c7f3336283 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:50.812112 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-ed33d115-0dde-4818-b89e-b1c7f3336283 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:50.823963 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ed33d115-0dde-4818-b89e-b1c7f3336283 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:50.824757 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ed33d115-0dde-4818-b89e-b1c7f3336283 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:50.826251 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ed33d115-0dde-4818-b89e-b1c7f3336283 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:50.826889 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ed33d115-0dde-4818-b89e-b1c7f3336283 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:50.986553 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-ed33d115-0dde-4818-b89e-b1c7f3336283 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.180351 Sep 02 17:12:50.987234 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 384/824] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:12:50 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:12:51.096999 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-88a07944-2b22-4f94-8f3c-91aa2d85c56b tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:51.097632 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-88a07944-2b22-4f94-8f3c-91aa2d85c56b tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:51.103893 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-88a07944-2b22-4f94-8f3c-91aa2d85c56b tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:51.104340 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-88a07944-2b22-4f94-8f3c-91aa2d85c56b tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:51.105113 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-88a07944-2b22-4f94-8f3c-91aa2d85c56b tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:51.105548 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-88a07944-2b22-4f94-8f3c-91aa2d85c56b tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:51.243705 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-88a07944-2b22-4f94-8f3c-91aa2d85c56b tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:51.250967 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-88a07944-2b22-4f94-8f3c-91aa2d85c56b tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1451 microversion: 2.1 time: 0.157542 Sep 02 17:12:51.251511 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 441/825] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:51 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:51.270360 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-2466a79e-e917-4182-b3d8-6f331988a71c tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:51.271173 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-2466a79e-e917-4182-b3d8-6f331988a71c tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:51.278010 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2466a79e-e917-4182-b3d8-6f331988a71c tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:51.278549 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2466a79e-e917-4182-b3d8-6f331988a71c tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:51.279423 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2466a79e-e917-4182-b3d8-6f331988a71c tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:51.279928 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2466a79e-e917-4182-b3d8-6f331988a71c tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:51.407619 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-2466a79e-e917-4182-b3d8-6f331988a71c tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:51.415597 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-2466a79e-e917-4182-b3d8-6f331988a71c tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1451 microversion: 2.1 time: 0.151042 Sep 02 17:12:51.416159 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 385/826] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:51 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:51.573122 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-f1f429ee-4ab1-41dd-8b16-71b84c1bca64 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:51.573917 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-f1f429ee-4ab1-41dd-8b16-71b84c1bca64 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 39f237e0-63e9-4871-9dd5-ab033d35ae67] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:51.579951 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f1f429ee-4ab1-41dd-8b16-71b84c1bca64 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:51.580474 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f1f429ee-4ab1-41dd-8b16-71b84c1bca64 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:51.581306 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f1f429ee-4ab1-41dd-8b16-71b84c1bca64 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:51.582602 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f1f429ee-4ab1-41dd-8b16-71b84c1bca64 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:51.723762 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-f1f429ee-4ab1-41dd-8b16-71b84c1bca64 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:51.731910 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-f1f429ee-4ab1-41dd-8b16-71b84c1bca64 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67" status: 200 len: 1511 microversion: 2.1 time: 0.162527 Sep 02 17:12:51.732473 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 442/827] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:51 2021] GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67 => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:51.999691 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-ecf9c882-ec7c-4c9c-be90-50fce6ae2bd1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:52.000712 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-ecf9c882-ec7c-4c9c-be90-50fce6ae2bd1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:52.007541 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ecf9c882-ec7c-4c9c-be90-50fce6ae2bd1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:52.007812 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ecf9c882-ec7c-4c9c-be90-50fce6ae2bd1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:52.008779 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ecf9c882-ec7c-4c9c-be90-50fce6ae2bd1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:52.009219 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ecf9c882-ec7c-4c9c-be90-50fce6ae2bd1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:52.749632 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-67cc16a1-7596-45e7-bcce-ec2235d81dfe tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:52.751071 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-67cc16a1-7596-45e7-bcce-ec2235d81dfe tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 39f237e0-63e9-4871-9dd5-ab033d35ae67] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:52.757013 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-67cc16a1-7596-45e7-bcce-ec2235d81dfe tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:52.757475 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-67cc16a1-7596-45e7-bcce-ec2235d81dfe tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:52.758261 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-67cc16a1-7596-45e7-bcce-ec2235d81dfe tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:52.758730 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-67cc16a1-7596-45e7-bcce-ec2235d81dfe tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:52.939031 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-67cc16a1-7596-45e7-bcce-ec2235d81dfe tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:52.946941 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-67cc16a1-7596-45e7-bcce-ec2235d81dfe tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67" status: 200 len: 1511 microversion: 2.1 time: 0.201202 Sep 02 17:12:52.947654 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 443/828] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:52 2021] GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67 => generated 1511 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:53.627244 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-f0984f24-875c-49bb-897f-ea1fa296399d req-e8eecc0d-e7bf-402d-8f71-837b97c8cf45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34e36f29-2bc8-4586-8de2-3a218984c046", "tag": "1af31c9b-4bff-4dc7-8b17-98d43795b25a"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:53.632076 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:12:53.632076 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:12:53.642476 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-f0984f24-875c-49bb-897f-ea1fa296399d req-e8eecc0d-e7bf-402d-8f71-837b97c8cf45 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:53.643347 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-f0984f24-875c-49bb-897f-ea1fa296399d req-e8eecc0d-e7bf-402d-8f71-837b97c8cf45 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:53.657411 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-f0984f24-875c-49bb-897f-ea1fa296399d req-e8eecc0d-e7bf-402d-8f71-837b97c8cf45 service nova] Creating event network-changed:1af31c9b-4bff-4dc7-8b17-98d43795b25a for instance 34e36f29-2bc8-4586-8de2-3a218984c046 on hv-cinder-80626 Sep 02 17:12:53.662351 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-f0984f24-875c-49bb-897f-ea1fa296399d req-e8eecc0d-e7bf-402d-8f71-837b97c8cf45 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039181 Sep 02 17:12:53.663040 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 444/829] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:12:53 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:12:53.965357 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-2cec4177-44be-4564-93c3-6fec3cef7ab0 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:53.966382 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-2cec4177-44be-4564-93c3-6fec3cef7ab0 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 39f237e0-63e9-4871-9dd5-ab033d35ae67] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:53.972716 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2cec4177-44be-4564-93c3-6fec3cef7ab0 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:53.973261 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2cec4177-44be-4564-93c3-6fec3cef7ab0 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:53.974132 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2cec4177-44be-4564-93c3-6fec3cef7ab0 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:53.974664 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2cec4177-44be-4564-93c3-6fec3cef7ab0 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:54.133902 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-ecf9c882-ec7c-4c9c-be90-50fce6ae2bd1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 2.137881 Sep 02 17:12:54.136270 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 386/830] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:12:51 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 2141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:12:54.136511 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-2cec4177-44be-4564-93c3-6fec3cef7ab0 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:54.145553 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-2cec4177-44be-4564-93c3-6fec3cef7ab0 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67" status: 200 len: 1511 microversion: 2.1 time: 0.184666 Sep 02 17:12:54.151341 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 445/831] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:53 2021] GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67 => generated 1511 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:12:55.148374 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-d47ffab1-04ee-4ce6-afa7-e294091d38a2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:55.150004 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-d47ffab1-04ee-4ce6-afa7-e294091d38a2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:55.163757 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-a0cc09b7-1366-4f1e-b17a-0a006960e9b4 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:55.164372 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-a0cc09b7-1366-4f1e-b17a-0a006960e9b4 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 39f237e0-63e9-4871-9dd5-ab033d35ae67] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:55.172606 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a0cc09b7-1366-4f1e-b17a-0a006960e9b4 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:55.173820 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d47ffab1-04ee-4ce6-afa7-e294091d38a2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:55.174502 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d47ffab1-04ee-4ce6-afa7-e294091d38a2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:55.175508 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d47ffab1-04ee-4ce6-afa7-e294091d38a2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:55.176269 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a0cc09b7-1366-4f1e-b17a-0a006960e9b4 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:55.176710 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d47ffab1-04ee-4ce6-afa7-e294091d38a2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:55.177062 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a0cc09b7-1366-4f1e-b17a-0a006960e9b4 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:55.177508 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a0cc09b7-1366-4f1e-b17a-0a006960e9b4 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:55.278181 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-d47ffab1-04ee-4ce6-afa7-e294091d38a2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.134595 Sep 02 17:12:55.279674 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 387/832] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:12:55 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:12:55.330564 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-a0cc09b7-1366-4f1e-b17a-0a006960e9b4 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:55.338084 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-a0cc09b7-1366-4f1e-b17a-0a006960e9b4 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67" status: 200 len: 1511 microversion: 2.1 time: 0.179253 Sep 02 17:12:55.338670 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 446/833] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:55 2021] GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67 => generated 1511 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:56.066658 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [req-66e41032-16b4-4fa3-8446-6f6f7bc3623b req-da59432a-eb97-474e-90da-b8e0e5fda00d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39f237e0-63e9-4871-9dd5-ab033d35ae67", "name": "network-vif-deleted", "tag": "e28d622c-3383-4e88-bb0f-f0ca44fe2164"}]} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:56.068175 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:12:56.068175 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: warnings.warn(msg) Sep 02 17:12:56.076234 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-66e41032-16b4-4fa3-8446-6f6f7bc3623b req-da59432a-eb97-474e-90da-b8e0e5fda00d service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:56.076676 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-66e41032-16b4-4fa3-8446-6f6f7bc3623b req-da59432a-eb97-474e-90da-b8e0e5fda00d service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:56.090172 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.compute.server_external_events [req-66e41032-16b4-4fa3-8446-6f6f7bc3623b req-da59432a-eb97-474e-90da-b8e0e5fda00d service nova] Creating event network-vif-deleted:e28d622c-3383-4e88-bb0f-f0ca44fe2164 for instance 39f237e0-63e9-4871-9dd5-ab033d35ae67 on hv-cinder-80626 Sep 02 17:12:56.095124 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [req-66e41032-16b4-4fa3-8446-6f6f7bc3623b req-da59432a-eb97-474e-90da-b8e0e5fda00d service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032482 Sep 02 17:12:56.095689 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 388/834] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:12:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:12:56.290716 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-ffe71803-0635-4ce7-acf3-54ae1f82ecc5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:56.291660 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-ffe71803-0635-4ce7-acf3-54ae1f82ecc5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:56.297617 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ffe71803-0635-4ce7-acf3-54ae1f82ecc5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:56.298060 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ffe71803-0635-4ce7-acf3-54ae1f82ecc5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:56.298858 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ffe71803-0635-4ce7-acf3-54ae1f82ecc5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:56.299296 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ffe71803-0635-4ce7-acf3-54ae1f82ecc5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:56.355296 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-8dd634d4-76d1-45c9-b994-2e5bc7b1e1ac tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:56.355977 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-8dd634d4-76d1-45c9-b994-2e5bc7b1e1ac tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 39f237e0-63e9-4871-9dd5-ab033d35ae67] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:56.362511 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8dd634d4-76d1-45c9-b994-2e5bc7b1e1ac tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:56.363379 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8dd634d4-76d1-45c9-b994-2e5bc7b1e1ac tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:56.364154 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8dd634d4-76d1-45c9-b994-2e5bc7b1e1ac tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:56.364587 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8dd634d4-76d1-45c9-b994-2e5bc7b1e1ac tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:56.388417 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-ffe71803-0635-4ce7-acf3-54ae1f82ecc5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.101102 Sep 02 17:12:56.389716 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 447/835] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:12:56 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:12:56.398932 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8dd634d4-76d1-45c9-b994-2e5bc7b1e1ac tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:56.399368 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8dd634d4-76d1-45c9-b994-2e5bc7b1e1ac tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:56.399815 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.objects.instance [None req-8dd634d4-76d1-45c9-b994-2e5bc7b1e1ac tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lazy-loading 'fault' on Instance uuid 39f237e0-63e9-4871-9dd5-ab033d35ae67 {{(pid=108417) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 17:12:56.440534 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-8dd634d4-76d1-45c9-b994-2e5bc7b1e1ac tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45335dcd625c4b819d42cacea1aaf946', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b68171454c54ab49ec2f23eb7573aa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:12:56.450072 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-8dd634d4-76d1-45c9-b994-2e5bc7b1e1ac tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67" status: 200 len: 1308 microversion: 2.1 time: 0.098842 Sep 02 17:12:56.450668 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 389/836] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:56 2021] GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67 => generated 1308 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:12:57.401269 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-1c0a3790-da7d-4e61-b6c1-ce35e5f7c869 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:57.402257 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-1c0a3790-da7d-4e61-b6c1-ce35e5f7c869 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:57.408739 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1c0a3790-da7d-4e61-b6c1-ce35e5f7c869 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:57.409180 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1c0a3790-da7d-4e61-b6c1-ce35e5f7c869 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:57.409945 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1c0a3790-da7d-4e61-b6c1-ce35e5f7c869 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:57.410986 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1c0a3790-da7d-4e61-b6c1-ce35e5f7c869 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:57.467881 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-94d2f841-b455-4def-aed7-16ce16e65df9 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:12:57.468478 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-94d2f841-b455-4def-aed7-16ce16e65df9 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] [instance: 39f237e0-63e9-4871-9dd5-ab033d35ae67] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:57.475177 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-94d2f841-b455-4def-aed7-16ce16e65df9 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:57.475619 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-94d2f841-b455-4def-aed7-16ce16e65df9 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:57.476499 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-94d2f841-b455-4def-aed7-16ce16e65df9 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:57.476994 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-94d2f841-b455-4def-aed7-16ce16e65df9 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:57.490867 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.wsgi [None req-94d2f841-b455-4def-aed7-16ce16e65df9 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] HTTP exception thrown: Instance 39f237e0-63e9-4871-9dd5-ab033d35ae67 could not be found. Sep 02 17:12:57.491543 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-94d2f841-b455-4def-aed7-16ce16e65df9 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] Returning 404 to user: Instance 39f237e0-63e9-4871-9dd5-ab033d35ae67 could not be found. {{(pid=108417) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:12:57.492190 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-94d2f841-b455-4def-aed7-16ce16e65df9 tempest-VolumesSnapshotTestJSON-242522770 tempest-VolumesSnapshotTestJSON-242522770-project] 10.222.0.41 "GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67" status: 404 len: 111 microversion: 2.1 time: 0.027941 Sep 02 17:12:57.492701 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 390/837] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:12:57 2021] GET /compute/v2.1/servers/39f237e0-63e9-4871-9dd5-ab033d35ae67 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 02 17:12:57.502359 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-1c0a3790-da7d-4e61-b6c1-ce35e5f7c869 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.104929 Sep 02 17:12:57.503038 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 448/838] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:12:57 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:12:58.513401 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-43a5a4ba-2df1-488d-90ad-5e4ee96d733b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:58.514309 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-43a5a4ba-2df1-488d-90ad-5e4ee96d733b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:58.520166 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-43a5a4ba-2df1-488d-90ad-5e4ee96d733b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:58.520616 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-43a5a4ba-2df1-488d-90ad-5e4ee96d733b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:58.521384 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-43a5a4ba-2df1-488d-90ad-5e4ee96d733b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:58.521822 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-43a5a4ba-2df1-488d-90ad-5e4ee96d733b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:58.610578 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-43a5a4ba-2df1-488d-90ad-5e4ee96d733b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.100719 Sep 02 17:12:58.611465 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 391/839] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:12:58 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:12:59.623881 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-d76dc28c-ef02-41ac-a601-bab72e97b6b2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:12:59.624967 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-d76dc28c-ef02-41ac-a601-bab72e97b6b2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:12:59.632389 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d76dc28c-ef02-41ac-a601-bab72e97b6b2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:59.632828 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d76dc28c-ef02-41ac-a601-bab72e97b6b2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:12:59.633607 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d76dc28c-ef02-41ac-a601-bab72e97b6b2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:12:59.634027 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d76dc28c-ef02-41ac-a601-bab72e97b6b2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:02.059047 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-d76dc28c-ef02-41ac-a601-bab72e97b6b2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 2.438961 Sep 02 17:13:02.063893 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 449/840] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:12:59 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 2441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:13:03.072365 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-d5393053-6ae7-4586-b74c-9f5856f6fb09 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:03.073364 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-d5393053-6ae7-4586-b74c-9f5856f6fb09 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:03.079936 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d5393053-6ae7-4586-b74c-9f5856f6fb09 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:03.080380 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d5393053-6ae7-4586-b74c-9f5856f6fb09 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:03.081151 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d5393053-6ae7-4586-b74c-9f5856f6fb09 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:03.081589 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d5393053-6ae7-4586-b74c-9f5856f6fb09 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:03.181449 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-d5393053-6ae7-4586-b74c-9f5856f6fb09 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.112844 Sep 02 17:13:03.182127 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 392/841] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:03 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:13:04.195794 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-c3b4810b-54db-4f9f-9507-95a1e4c7786a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:04.196796 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-c3b4810b-54db-4f9f-9507-95a1e4c7786a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:04.204779 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c3b4810b-54db-4f9f-9507-95a1e4c7786a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:04.205232 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c3b4810b-54db-4f9f-9507-95a1e4c7786a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:04.206016 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c3b4810b-54db-4f9f-9507-95a1e4c7786a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:04.206453 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c3b4810b-54db-4f9f-9507-95a1e4c7786a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:04.306746 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-c3b4810b-54db-4f9f-9507-95a1e4c7786a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.115736 Sep 02 17:13:04.307382 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 450/842] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:04 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:13:05.319812 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-c2840b0c-7ba6-409b-ae4d-a491ca1fb690 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:05.320559 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-c2840b0c-7ba6-409b-ae4d-a491ca1fb690 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:05.326871 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c2840b0c-7ba6-409b-ae4d-a491ca1fb690 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:05.327311 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c2840b0c-7ba6-409b-ae4d-a491ca1fb690 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:05.328066 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c2840b0c-7ba6-409b-ae4d-a491ca1fb690 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:05.328492 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c2840b0c-7ba6-409b-ae4d-a491ca1fb690 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:05.426396 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-c2840b0c-7ba6-409b-ae4d-a491ca1fb690 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.110747 Sep 02 17:13:05.427343 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 393/843] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:05 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:13:06.439177 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-8458b5ef-ac11-4baa-88c8-1e871df45294 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:06.440164 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-8458b5ef-ac11-4baa-88c8-1e871df45294 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:06.446883 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8458b5ef-ac11-4baa-88c8-1e871df45294 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:06.447333 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8458b5ef-ac11-4baa-88c8-1e871df45294 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:06.448107 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8458b5ef-ac11-4baa-88c8-1e871df45294 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:06.448544 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8458b5ef-ac11-4baa-88c8-1e871df45294 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:06.537297 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-8458b5ef-ac11-4baa-88c8-1e871df45294 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.101844 Sep 02 17:13:06.538088 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 451/844] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:06 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:13:07.549397 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-e2d20982-49d7-419a-8c26-90efac15efb9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:07.551032 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-e2d20982-49d7-419a-8c26-90efac15efb9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:07.557551 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e2d20982-49d7-419a-8c26-90efac15efb9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:07.557989 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e2d20982-49d7-419a-8c26-90efac15efb9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:07.558912 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e2d20982-49d7-419a-8c26-90efac15efb9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:07.562825 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e2d20982-49d7-419a-8c26-90efac15efb9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:10.391130 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-e2d20982-49d7-419a-8c26-90efac15efb9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 2.845693 Sep 02 17:13:10.391893 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 394/845] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:07 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 2848 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:13:11.404369 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-688246c2-d18e-4cb9-891f-b4c02333a086 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:11.405214 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-688246c2-d18e-4cb9-891f-b4c02333a086 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:11.412525 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-688246c2-d18e-4cb9-891f-b4c02333a086 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:11.413010 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-688246c2-d18e-4cb9-891f-b4c02333a086 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:11.413810 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-688246c2-d18e-4cb9-891f-b4c02333a086 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:11.414246 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-688246c2-d18e-4cb9-891f-b4c02333a086 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:11.509409 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-688246c2-d18e-4cb9-891f-b4c02333a086 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.108913 Sep 02 17:13:11.513545 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 452/846] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:11 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:13:12.522815 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-e8fc1737-d85c-46e7-a3e7-9c6730b14b14 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:12.523738 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-e8fc1737-d85c-46e7-a3e7-9c6730b14b14 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:12.530690 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e8fc1737-d85c-46e7-a3e7-9c6730b14b14 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:12.531265 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e8fc1737-d85c-46e7-a3e7-9c6730b14b14 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:12.532042 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e8fc1737-d85c-46e7-a3e7-9c6730b14b14 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:12.532480 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e8fc1737-d85c-46e7-a3e7-9c6730b14b14 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:12.623755 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-e8fc1737-d85c-46e7-a3e7-9c6730b14b14 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.105769 Sep 02 17:13:12.624667 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 395/847] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:12 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:13:13.636802 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-39cdfee0-358a-40ac-969a-f856e0521837 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:13.637709 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-39cdfee0-358a-40ac-969a-f856e0521837 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:13.644047 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-39cdfee0-358a-40ac-969a-f856e0521837 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:13.644494 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-39cdfee0-358a-40ac-969a-f856e0521837 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:13.645253 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-39cdfee0-358a-40ac-969a-f856e0521837 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:13.645682 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-39cdfee0-358a-40ac-969a-f856e0521837 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:13.732384 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-39cdfee0-358a-40ac-969a-f856e0521837 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.099663 Sep 02 17:13:13.733301 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 453/848] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:13 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:13:14.745831 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-0a0b6ec7-8eab-4f0c-ab92-13d1d1841e98 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:14.746880 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-0a0b6ec7-8eab-4f0c-ab92-13d1d1841e98 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:14.754164 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0a0b6ec7-8eab-4f0c-ab92-13d1d1841e98 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:14.754647 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0a0b6ec7-8eab-4f0c-ab92-13d1d1841e98 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:14.755632 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0a0b6ec7-8eab-4f0c-ab92-13d1d1841e98 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:14.756104 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0a0b6ec7-8eab-4f0c-ab92-13d1d1841e98 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:14.850842 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-0a0b6ec7-8eab-4f0c-ab92-13d1d1841e98 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.109696 Sep 02 17:13:14.851735 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 396/849] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:14 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:13:15.862127 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-7e1aca22-ec78-4a99-815e-2d3d63f1760e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:15.863432 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-7e1aca22-ec78-4a99-815e-2d3d63f1760e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:15.870115 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7e1aca22-ec78-4a99-815e-2d3d63f1760e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:15.870565 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7e1aca22-ec78-4a99-815e-2d3d63f1760e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:15.871375 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7e1aca22-ec78-4a99-815e-2d3d63f1760e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:15.871806 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7e1aca22-ec78-4a99-815e-2d3d63f1760e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:15.966839 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-7e1aca22-ec78-4a99-815e-2d3d63f1760e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.108540 Sep 02 17:13:15.967738 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 454/850] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:15 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:13:16.979492 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-bca02a95-3465-4608-97a4-3a610487d3b0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:16.980401 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-bca02a95-3465-4608-97a4-3a610487d3b0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:16.986970 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-bca02a95-3465-4608-97a4-3a610487d3b0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:16.987420 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-bca02a95-3465-4608-97a4-3a610487d3b0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:16.988455 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-bca02a95-3465-4608-97a4-3a610487d3b0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:16.988891 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-bca02a95-3465-4608-97a4-3a610487d3b0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:17.085010 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-bca02a95-3465-4608-97a4-3a610487d3b0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.109481 Sep 02 17:13:17.085739 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 397/851] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:16 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:13:18.097213 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-535f2cc3-6714-48a1-9b3d-5f5017a10ce7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:18.098210 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-535f2cc3-6714-48a1-9b3d-5f5017a10ce7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:18.105778 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-535f2cc3-6714-48a1-9b3d-5f5017a10ce7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:18.106227 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-535f2cc3-6714-48a1-9b3d-5f5017a10ce7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:18.107311 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-535f2cc3-6714-48a1-9b3d-5f5017a10ce7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:18.107574 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-535f2cc3-6714-48a1-9b3d-5f5017a10ce7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:18.212904 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-535f2cc3-6714-48a1-9b3d-5f5017a10ce7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.119564 Sep 02 17:13:18.213827 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 455/852] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:18 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:13:19.225354 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-0da3744d-1a1e-4a51-8620-e06f75449f5d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:19.226492 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-0da3744d-1a1e-4a51-8620-e06f75449f5d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:19.233061 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0da3744d-1a1e-4a51-8620-e06f75449f5d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:19.233500 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0da3744d-1a1e-4a51-8620-e06f75449f5d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:19.234258 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0da3744d-1a1e-4a51-8620-e06f75449f5d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:19.234708 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0da3744d-1a1e-4a51-8620-e06f75449f5d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:19.328142 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-0da3744d-1a1e-4a51-8620-e06f75449f5d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.106691 Sep 02 17:13:19.328798 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 398/853] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:19 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:13:20.381142 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-28f7b40a-2d4a-48a7-ad8d-92672f39b7a2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:20.382139 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-28f7b40a-2d4a-48a7-ad8d-92672f39b7a2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:20.389138 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-28f7b40a-2d4a-48a7-ad8d-92672f39b7a2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:20.389564 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-28f7b40a-2d4a-48a7-ad8d-92672f39b7a2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:20.390339 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-28f7b40a-2d4a-48a7-ad8d-92672f39b7a2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:20.390799 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-28f7b40a-2d4a-48a7-ad8d-92672f39b7a2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:20.486813 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-28f7b40a-2d4a-48a7-ad8d-92672f39b7a2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.109926 Sep 02 17:13:20.487524 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 456/854] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:20 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:13:21.499408 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-bd3e71f7-599f-4593-9d2d-2dc80d5eec1d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:21.500533 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-bd3e71f7-599f-4593-9d2d-2dc80d5eec1d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:21.507728 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-bd3e71f7-599f-4593-9d2d-2dc80d5eec1d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:21.508574 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-bd3e71f7-599f-4593-9d2d-2dc80d5eec1d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:21.509363 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-bd3e71f7-599f-4593-9d2d-2dc80d5eec1d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:21.509797 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-bd3e71f7-599f-4593-9d2d-2dc80d5eec1d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:21.612379 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-bd3e71f7-599f-4593-9d2d-2dc80d5eec1d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.117270 Sep 02 17:13:21.613477 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 399/855] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:21 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:13:22.624905 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-9c6fe408-26c4-45b8-95a2-81945aafde93 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:22.625911 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-9c6fe408-26c4-45b8-95a2-81945aafde93 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:22.633365 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9c6fe408-26c4-45b8-95a2-81945aafde93 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:22.633631 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9c6fe408-26c4-45b8-95a2-81945aafde93 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:22.634422 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9c6fe408-26c4-45b8-95a2-81945aafde93 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:22.635031 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9c6fe408-26c4-45b8-95a2-81945aafde93 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:22.726931 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-9c6fe408-26c4-45b8-95a2-81945aafde93 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.105821 Sep 02 17:13:22.727583 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 457/856] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:22 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:13:23.739953 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-66e0147b-f9d8-4d1e-be17-c51d0ba3cc07 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:23.740961 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-66e0147b-f9d8-4d1e-be17-c51d0ba3cc07 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:23.747641 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-66e0147b-f9d8-4d1e-be17-c51d0ba3cc07 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:23.749492 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-66e0147b-f9d8-4d1e-be17-c51d0ba3cc07 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:23.750464 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-66e0147b-f9d8-4d1e-be17-c51d0ba3cc07 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:23.750999 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-66e0147b-f9d8-4d1e-be17-c51d0ba3cc07 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:26.548442 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-66e0147b-f9d8-4d1e-be17-c51d0ba3cc07 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 2.812567 Sep 02 17:13:26.549393 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 400/857] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:23 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 2815 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:13:27.561164 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-25743e73-c56a-4be0-97e0-bad53452ec59 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:27.562453 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-25743e73-c56a-4be0-97e0-bad53452ec59 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:27.570096 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-25743e73-c56a-4be0-97e0-bad53452ec59 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:27.570659 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-25743e73-c56a-4be0-97e0-bad53452ec59 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:27.571503 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-25743e73-c56a-4be0-97e0-bad53452ec59 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:27.572148 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-25743e73-c56a-4be0-97e0-bad53452ec59 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:27.700034 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-25743e73-c56a-4be0-97e0-bad53452ec59 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.142977 Sep 02 17:13:27.700690 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 458/858] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:27 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:13:28.712953 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-0155f99f-0f27-4795-9567-0ca328b19bc0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:28.713989 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-0155f99f-0f27-4795-9567-0ca328b19bc0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:28.720702 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0155f99f-0f27-4795-9567-0ca328b19bc0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:28.721159 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0155f99f-0f27-4795-9567-0ca328b19bc0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:28.721989 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0155f99f-0f27-4795-9567-0ca328b19bc0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:28.722421 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0155f99f-0f27-4795-9567-0ca328b19bc0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:31.083559 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-0155f99f-0f27-4795-9567-0ca328b19bc0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 2.374562 Sep 02 17:13:31.085214 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 401/859] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:28 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 2377 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:13:32.096161 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-ccd2d127-148b-4379-bb4d-c0fb53a0000d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:32.097247 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-ccd2d127-148b-4379-bb4d-c0fb53a0000d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:32.107575 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ccd2d127-148b-4379-bb4d-c0fb53a0000d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:32.108145 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ccd2d127-148b-4379-bb4d-c0fb53a0000d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:32.109070 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ccd2d127-148b-4379-bb4d-c0fb53a0000d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:32.109630 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ccd2d127-148b-4379-bb4d-c0fb53a0000d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:32.195672 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-9fc3def7-0f3b-4a48-b977-a03872978e3b tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Action: 'create', calling method: .version_select at 0x7fca98503310>, body: {"keypair": {"name": "tempest-TestShelveInstance-1011419605"}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:32.205416 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-ccd2d127-148b-4379-bb4d-c0fb53a0000d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.112736 Sep 02 17:13:32.206560 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 402/860] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:32 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:13:32.215173 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.quota [None req-9fc3def7-0f3b-4a48-b977-a03872978e3b tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Getting quotas for project 1187a96ac5fd43ed8833b20d6e853409. Resources: {'key_pairs'} {{(pid=108418) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 17:13:32.219715 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.quota [None req-9fc3def7-0f3b-4a48-b977-a03872978e3b tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Getting quotas for user bdfa1e28abf74f40b4d4456142c8f33e and project 1187a96ac5fd43ed8833b20d6e853409. Resources: {'key_pairs'} {{(pid=108418) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 17:13:32.660727 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.quota [None req-9fc3def7-0f3b-4a48-b977-a03872978e3b tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Getting quotas for project 1187a96ac5fd43ed8833b20d6e853409. Resources: {'key_pairs'} {{(pid=108418) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 17:13:32.664366 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.quota [None req-9fc3def7-0f3b-4a48-b977-a03872978e3b tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Getting quotas for user bdfa1e28abf74f40b4d4456142c8f33e and project 1187a96ac5fd43ed8833b20d6e853409. Resources: {'key_pairs'} {{(pid=108418) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 17:13:32.677658 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-9fc3def7-0f3b-4a48-b977-a03872978e3b tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.720249 Sep 02 17:13:32.678253 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 459/861] 10.222.0.41 () {60 vars in 1158 bytes} [Thu Sep 2 17:13:31 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:13:33.236078 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-f88ad39f-405d-4c8a-8fcf-c9297ae8e377 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:33.237209 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-f88ad39f-405d-4c8a-8fcf-c9297ae8e377 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:33.251889 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f88ad39f-405d-4c8a-8fcf-c9297ae8e377 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:33.251889 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f88ad39f-405d-4c8a-8fcf-c9297ae8e377 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:33.251889 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f88ad39f-405d-4c8a-8fcf-c9297ae8e377 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:33.252379 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f88ad39f-405d-4c8a-8fcf-c9297ae8e377 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:35.287589 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-f88ad39f-405d-4c8a-8fcf-c9297ae8e377 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 2.068431 Sep 02 17:13:35.290893 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 403/862] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:33 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 2076 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:13:36.300161 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-962b37b4-c38b-42b5-bc08-dc583387514a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:36.301274 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-962b37b4-c38b-42b5-bc08-dc583387514a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:36.308059 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-962b37b4-c38b-42b5-bc08-dc583387514a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:36.308510 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-962b37b4-c38b-42b5-bc08-dc583387514a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:36.309264 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-962b37b4-c38b-42b5-bc08-dc583387514a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:36.309697 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-962b37b4-c38b-42b5-bc08-dc583387514a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:36.406167 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-962b37b4-c38b-42b5-bc08-dc583387514a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.110086 Sep 02 17:13:36.406819 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 460/863] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:36 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:13:37.418860 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-3eedf3a5-bbea-4e0a-aedd-e3f364cfe1e2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:37.421104 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-3eedf3a5-bbea-4e0a-aedd-e3f364cfe1e2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:37.428353 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3eedf3a5-bbea-4e0a-aedd-e3f364cfe1e2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:37.428792 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3eedf3a5-bbea-4e0a-aedd-e3f364cfe1e2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:37.429597 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3eedf3a5-bbea-4e0a-aedd-e3f364cfe1e2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:37.430032 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3eedf3a5-bbea-4e0a-aedd-e3f364cfe1e2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:37.526972 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-3eedf3a5-bbea-4e0a-aedd-e3f364cfe1e2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.112189 Sep 02 17:13:37.527879 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 404/864] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:37 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:13:38.480850 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-a3cac89f-a66f-4d85-b064-cb6861273a89 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:13:38.481585 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-a3cac89f-a66f-4d85-b064-cb6861273a89 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:38.489126 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a3cac89f-a66f-4d85-b064-cb6861273a89 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:38.489572 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a3cac89f-a66f-4d85-b064-cb6861273a89 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:38.490336 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a3cac89f-a66f-4d85-b064-cb6861273a89 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:38.490867 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a3cac89f-a66f-4d85-b064-cb6861273a89 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:38.519921 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-a3cac89f-a66f-4d85-b064-cb6861273a89 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/os-volume_attachments/47747882-9ad2-4c90-9c96-3b72e24e1413" status: 200 len: 194 microversion: 2.20 time: 0.043776 Sep 02 17:13:38.520488 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 461/865] 10.222.0.41 () {60 vars in 1454 bytes} [Thu Sep 2 17:13:38 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/os-volume_attachments/47747882-9ad2-4c90-9c96-3b72e24e1413 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:13:38.540251 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-ee34324a-a031-4e52-a170-9aaa7449ccf7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:38.541231 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-ee34324a-a031-4e52-a170-9aaa7449ccf7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:38.547559 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ee34324a-a031-4e52-a170-9aaa7449ccf7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:38.547995 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ee34324a-a031-4e52-a170-9aaa7449ccf7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:38.548748 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ee34324a-a031-4e52-a170-9aaa7449ccf7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:38.549170 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ee34324a-a031-4e52-a170-9aaa7449ccf7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:38.588012 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-e2a13759-8cf5-4ec5-b3e3-9b5f6cc29631 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:13:38.588426 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-e2a13759-8cf5-4ec5-b3e3-9b5f6cc29631 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:38.594252 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e2a13759-8cf5-4ec5-b3e3-9b5f6cc29631 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:38.594729 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e2a13759-8cf5-4ec5-b3e3-9b5f6cc29631 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:38.595489 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e2a13759-8cf5-4ec5-b3e3-9b5f6cc29631 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:38.597442 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e2a13759-8cf5-4ec5-b3e3-9b5f6cc29631 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:38.655338 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-ee34324a-a031-4e52-a170-9aaa7449ccf7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.118969 Sep 02 17:13:38.656260 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 405/866] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:38 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:13:38.684238 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.objects.instance [None req-e2a13759-8cf5-4ec5-b3e3-9b5f6cc29631 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lazy-loading 'services' on Instance uuid 4e92c68a-a864-4562-b08b-d244394268ce {{(pid=108418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 17:13:38.845688 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-e2a13759-8cf5-4ec5-b3e3-9b5f6cc29631 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/os-volume_attachments/47747882-9ad2-4c90-9c96-3b72e24e1413" status: 202 len: 0 microversion: 2.20 time: 0.261548 Sep 02 17:13:38.846505 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 462/867] 10.222.0.41 () {60 vars in 1457 bytes} [Thu Sep 2 17:13:38 2021] DELETE /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/os-volume_attachments/47747882-9ad2-4c90-9c96-3b72e24e1413 => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 02 17:13:38.856004 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-7caa383e-1863-49d9-8831-2586b9af684b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:13:38.856978 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-7caa383e-1863-49d9-8831-2586b9af684b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:38.864012 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7caa383e-1863-49d9-8831-2586b9af684b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:38.864456 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7caa383e-1863-49d9-8831-2586b9af684b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:38.865250 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7caa383e-1863-49d9-8831-2586b9af684b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:38.865853 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7caa383e-1863-49d9-8831-2586b9af684b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:38.895233 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-7caa383e-1863-49d9-8831-2586b9af684b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043266 Sep 02 17:13:38.895803 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 406/868] 10.222.0.41 () {60 vars in 1343 bytes} [Thu Sep 2 17:13:38 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:13:39.667903 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-1fb643cd-092d-461f-9b1f-8dd3bc5e009d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:39.668982 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-1fb643cd-092d-461f-9b1f-8dd3bc5e009d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:39.675997 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1fb643cd-092d-461f-9b1f-8dd3bc5e009d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:39.676512 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1fb643cd-092d-461f-9b1f-8dd3bc5e009d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:39.677275 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1fb643cd-092d-461f-9b1f-8dd3bc5e009d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:39.677702 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1fb643cd-092d-461f-9b1f-8dd3bc5e009d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:39.762312 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-1fb643cd-092d-461f-9b1f-8dd3bc5e009d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.098440 Sep 02 17:13:39.763436 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 463/869] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:39 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:13:39.906905 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-f95565d0-0c1a-43b9-9f4d-1d358562a2ee tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:13:39.907837 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-f95565d0-0c1a-43b9-9f4d-1d358562a2ee tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:39.914321 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f95565d0-0c1a-43b9-9f4d-1d358562a2ee tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:39.914801 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f95565d0-0c1a-43b9-9f4d-1d358562a2ee tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:39.915569 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f95565d0-0c1a-43b9-9f4d-1d358562a2ee tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:39.916005 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f95565d0-0c1a-43b9-9f4d-1d358562a2ee tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:39.947073 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-f95565d0-0c1a-43b9-9f4d-1d358562a2ee tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043759 Sep 02 17:13:39.947763 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 407/870] 10.222.0.41 () {60 vars in 1343 bytes} [Thu Sep 2 17:13:39 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:13:40.007022 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-d058238b-fa26-43ba-b5d4-686a3023ef85 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:13:40.007634 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-d058238b-fa26-43ba-b5d4-686a3023ef85 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:40.013990 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d058238b-fa26-43ba-b5d4-686a3023ef85 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:40.014432 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d058238b-fa26-43ba-b5d4-686a3023ef85 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:40.015232 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d058238b-fa26-43ba-b5d4-686a3023ef85 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:40.015669 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d058238b-fa26-43ba-b5d4-686a3023ef85 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:40.038720 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-d058238b-fa26-43ba-b5d4-686a3023ef85 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Going to try to terminate instance {{(pid=108418) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 17:13:40.113926 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-d058238b-fa26-43ba-b5d4-686a3023ef85 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 204 len: 0 microversion: 2.20 time: 0.110636 Sep 02 17:13:40.114591 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 464/871] 10.222.0.41 () {60 vars in 1280 bytes} [Thu Sep 2 17:13:40 2021] DELETE /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 02 17:13:40.122824 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-e1af46ba-1e5c-4bd3-a59e-a9059596aab5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:13:40.123431 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-e1af46ba-1e5c-4bd3-a59e-a9059596aab5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:40.129870 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e1af46ba-1e5c-4bd3-a59e-a9059596aab5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:40.130315 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e1af46ba-1e5c-4bd3-a59e-a9059596aab5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:40.131110 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e1af46ba-1e5c-4bd3-a59e-a9059596aab5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:40.131541 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e1af46ba-1e5c-4bd3-a59e-a9059596aab5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:40.353184 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-e1af46ba-1e5c-4bd3-a59e-a9059596aab5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:40.360866 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-e1af46ba-1e5c-4bd3-a59e-a9059596aab5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:40.362365 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-e1af46ba-1e5c-4bd3-a59e-a9059596aab5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:40.364525 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-e1af46ba-1e5c-4bd3-a59e-a9059596aab5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1722 microversion: 2.20 time: 0.244617 Sep 02 17:13:40.365080 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 408/872] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:13:40 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:13:40.776027 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-c36cc5fd-408b-46bd-90e9-cc441a5b1b18 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:40.776975 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-c36cc5fd-408b-46bd-90e9-cc441a5b1b18 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:40.782750 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c36cc5fd-408b-46bd-90e9-cc441a5b1b18 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:40.783193 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c36cc5fd-408b-46bd-90e9-cc441a5b1b18 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:40.783970 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c36cc5fd-408b-46bd-90e9-cc441a5b1b18 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:40.784438 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c36cc5fd-408b-46bd-90e9-cc441a5b1b18 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:40.895374 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-c36cc5fd-408b-46bd-90e9-cc441a5b1b18 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.122853 Sep 02 17:13:40.896147 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 465/873] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:40 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:13:41.383389 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-84a0fe3b-fa9a-40a7-aecb-74d2f1dd8951 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:13:41.384010 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-84a0fe3b-fa9a-40a7-aecb-74d2f1dd8951 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:41.389872 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-84a0fe3b-fa9a-40a7-aecb-74d2f1dd8951 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:41.390323 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-84a0fe3b-fa9a-40a7-aecb-74d2f1dd8951 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:41.391117 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-84a0fe3b-fa9a-40a7-aecb-74d2f1dd8951 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:41.391551 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-84a0fe3b-fa9a-40a7-aecb-74d2f1dd8951 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:41.516000 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-84a0fe3b-fa9a-40a7-aecb-74d2f1dd8951 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:41.524596 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-84a0fe3b-fa9a-40a7-aecb-74d2f1dd8951 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:41.525518 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-84a0fe3b-fa9a-40a7-aecb-74d2f1dd8951 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:41.526715 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-84a0fe3b-fa9a-40a7-aecb-74d2f1dd8951 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1722 microversion: 2.20 time: 0.147662 Sep 02 17:13:41.527442 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 409/874] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:13:41 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:13:41.908351 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-ecc8abab-82b5-41d1-ad21-b852d58b5c5f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:41.912260 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-ecc8abab-82b5-41d1-ad21-b852d58b5c5f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:41.919703 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ecc8abab-82b5-41d1-ad21-b852d58b5c5f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:41.920263 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ecc8abab-82b5-41d1-ad21-b852d58b5c5f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:41.921199 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ecc8abab-82b5-41d1-ad21-b852d58b5c5f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:41.921641 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ecc8abab-82b5-41d1-ad21-b852d58b5c5f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:42.021368 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-ecc8abab-82b5-41d1-ad21-b852d58b5c5f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.117437 Sep 02 17:13:42.022106 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 466/875] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:41 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:13:42.545052 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-1726b89d-966b-46a9-9f1e-1f50fb432c16 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:13:42.546203 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-1726b89d-966b-46a9-9f1e-1f50fb432c16 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:42.552928 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1726b89d-966b-46a9-9f1e-1f50fb432c16 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:42.553640 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1726b89d-966b-46a9-9f1e-1f50fb432c16 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:42.554179 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1726b89d-966b-46a9-9f1e-1f50fb432c16 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:42.554619 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1726b89d-966b-46a9-9f1e-1f50fb432c16 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:42.939472 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-1726b89d-966b-46a9-9f1e-1f50fb432c16 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:42.947985 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-1726b89d-966b-46a9-9f1e-1f50fb432c16 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:42.949502 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-1726b89d-966b-46a9-9f1e-1f50fb432c16 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:42.950670 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-1726b89d-966b-46a9-9f1e-1f50fb432c16 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 200 len: 1722 microversion: 2.20 time: 0.409712 Sep 02 17:13:42.951218 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 410/876] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:13:42 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 1722 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:13:43.035767 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-65409ca6-8b65-45c1-972f-eceb2a154412 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:43.036843 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-65409ca6-8b65-45c1-972f-eceb2a154412 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:43.043362 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-65409ca6-8b65-45c1-972f-eceb2a154412 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:43.043804 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-65409ca6-8b65-45c1-972f-eceb2a154412 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:43.044566 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-65409ca6-8b65-45c1-972f-eceb2a154412 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:43.044992 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-65409ca6-8b65-45c1-972f-eceb2a154412 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:43.137460 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-65409ca6-8b65-45c1-972f-eceb2a154412 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.106900 Sep 02 17:13:43.138025 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 467/877] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:43 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:13:43.370356 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [req-e741005b-2c98-49dd-a9d4-ee4614adf37e req-516b8ed9-0700-4341-a1c6-33b9807778ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e92c68a-a864-4562-b08b-d244394268ce", "name": "network-vif-deleted", "tag": "0a87c875-7882-47c2-a092-e14ea53f2b64"}]} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:43.373976 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:13:43.373976 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: warnings.warn(msg) Sep 02 17:13:43.381987 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-e741005b-2c98-49dd-a9d4-ee4614adf37e req-516b8ed9-0700-4341-a1c6-33b9807778ca service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:43.382433 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-e741005b-2c98-49dd-a9d4-ee4614adf37e req-516b8ed9-0700-4341-a1c6-33b9807778ca service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:43.394352 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.compute.server_external_events [req-e741005b-2c98-49dd-a9d4-ee4614adf37e req-516b8ed9-0700-4341-a1c6-33b9807778ca service nova] Creating event network-vif-deleted:0a87c875-7882-47c2-a092-e14ea53f2b64 for instance 4e92c68a-a864-4562-b08b-d244394268ce on hv-cinder-80626 Sep 02 17:13:43.413378 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [req-e741005b-2c98-49dd-a9d4-ee4614adf37e req-516b8ed9-0700-4341-a1c6-33b9807778ca service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046758 Sep 02 17:13:43.414188 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 411/878] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:13:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:13:43.969315 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-1f7b6dfd-6f26-4df4-9797-6dfadb215786 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:13:43.970097 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-1f7b6dfd-6f26-4df4-9797-6dfadb215786 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:43.978076 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1f7b6dfd-6f26-4df4-9797-6dfadb215786 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:43.978756 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1f7b6dfd-6f26-4df4-9797-6dfadb215786 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:43.979613 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1f7b6dfd-6f26-4df4-9797-6dfadb215786 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:43.980961 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1f7b6dfd-6f26-4df4-9797-6dfadb215786 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:43.997191 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.wsgi [None req-1f7b6dfd-6f26-4df4-9797-6dfadb215786 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] HTTP exception thrown: Instance 4e92c68a-a864-4562-b08b-d244394268ce could not be found. Sep 02 17:13:43.997941 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-1f7b6dfd-6f26-4df4-9797-6dfadb215786 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Returning 404 to user: Instance 4e92c68a-a864-4562-b08b-d244394268ce could not be found. {{(pid=108418) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:13:43.998879 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-1f7b6dfd-6f26-4df4-9797-6dfadb215786 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 404 len: 111 microversion: 2.20 time: 0.034223 Sep 02 17:13:43.999804 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 468/879] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:13:43 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 02 17:13:44.009270 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-f45c7a5d-4684-42fa-b8fd-4c42623171a0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '.version_select at 0x7fca98502310>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:13:44.045301 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-f45c7a5d-4684-42fa-b8fd-4c42623171a0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-570871693" status: 204 len: 0 microversion: 2.20 time: 0.040530 Sep 02 17:13:44.049429 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 412/880] 10.222.0.41 () {60 vars in 1259 bytes} [Thu Sep 2 17:13:44 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-570871693 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 02 17:13:44.151065 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-c4d78776-2458-4a79-9f70-747f151864d0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:44.152542 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-c4d78776-2458-4a79-9f70-747f151864d0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:44.160598 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c4d78776-2458-4a79-9f70-747f151864d0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:44.161237 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c4d78776-2458-4a79-9f70-747f151864d0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:44.162359 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c4d78776-2458-4a79-9f70-747f151864d0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:44.163054 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c4d78776-2458-4a79-9f70-747f151864d0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:44.273192 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-c4d78776-2458-4a79-9f70-747f151864d0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.126537 Sep 02 17:13:44.273984 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 469/881] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:44 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:13:44.756663 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-64866c2f-fb4c-4353-a476-4819c8807f93 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'create', calling method: .version_select at 0x7fca984d3670>, body: {"keypair": {"name": "tempest-keypair-2014514500"}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:44.777699 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.quota [None req-64866c2f-fb4c-4353-a476-4819c8807f93 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Getting quotas for project 70d941aa2c0e4b9eac9950e6e8237615. Resources: {'key_pairs'} {{(pid=108417) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 17:13:44.782494 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.quota [None req-64866c2f-fb4c-4353-a476-4819c8807f93 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Getting quotas for user d11ab044b0ba41be87b038204b161d8f and project 70d941aa2c0e4b9eac9950e6e8237615. Resources: {'key_pairs'} {{(pid=108417) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 17:13:44.932678 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.quota [None req-64866c2f-fb4c-4353-a476-4819c8807f93 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Getting quotas for project 70d941aa2c0e4b9eac9950e6e8237615. Resources: {'key_pairs'} {{(pid=108417) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 17:13:44.936309 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.quota [None req-64866c2f-fb4c-4353-a476-4819c8807f93 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Getting quotas for user d11ab044b0ba41be87b038204b161d8f and project 70d941aa2c0e4b9eac9950e6e8237615. Resources: {'key_pairs'} {{(pid=108417) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 17:13:44.950348 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-64866c2f-fb4c-4353-a476-4819c8807f93 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.198043 Sep 02 17:13:44.956296 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 413/882] 10.222.0.41 () {62 vars in 1199 bytes} [Thu Sep 2 17:13:44 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 200 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Sep 02 17:13:45.285919 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-56365d24-8eb7-4fd7-8457-47bb6ac08e41 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:45.286951 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-56365d24-8eb7-4fd7-8457-47bb6ac08e41 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:45.293370 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-56365d24-8eb7-4fd7-8457-47bb6ac08e41 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:45.293824 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-56365d24-8eb7-4fd7-8457-47bb6ac08e41 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:45.294592 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-56365d24-8eb7-4fd7-8457-47bb6ac08e41 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:45.295059 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-56365d24-8eb7-4fd7-8457-47bb6ac08e41 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:45.388453 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-56365d24-8eb7-4fd7-8457-47bb6ac08e41 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.106466 Sep 02 17:13:45.389350 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 470/883] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:45 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:13:46.257788 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-aaf0d908-5a09-4442-bcc9-70014f128534 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-92128000", "imageRef": "22ce6e29-f3a7-49f0-b93a-ddbffa14e44e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "94c8cbb5-40fd-4da4-849b-703835a0088e"}], "security_groups": [{"name": "tempest-securitygroup--1675566191"}], "key_name": "tempest-keypair-2014514500", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:46.349600 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.network.neutron [None req-aaf0d908-5a09-4442-bcc9-70014f128534 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] validate_networks() for [('94c8cbb5-40fd-4da4-849b-703835a0088e', None, None, None, None, None)] {{(pid=108417) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 17:13:46.401562 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-93ec8191-d13e-4f1c-8879-f937a7a12e84 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:46.402501 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-93ec8191-d13e-4f1c-8879-f937a7a12e84 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:46.409147 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-93ec8191-d13e-4f1c-8879-f937a7a12e84 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:46.409597 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-93ec8191-d13e-4f1c-8879-f937a7a12e84 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:46.411023 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-93ec8191-d13e-4f1c-8879-f937a7a12e84 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:46.411461 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-93ec8191-d13e-4f1c-8879-f937a7a12e84 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:46.501025 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-93ec8191-d13e-4f1c-8879-f937a7a12e84 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.103471 Sep 02 17:13:46.503364 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 471/884] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:46 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:13:46.814737 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-aaf0d908-5a09-4442-bcc9-70014f128534 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Flavor limits 0:0:0 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 17:13:46.815154 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-aaf0d908-5a09-4442-bcc9-70014f128534 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Image limits 0:0:0 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 17:13:46.815649 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-aaf0d908-5a09-4442-bcc9-70014f128534 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Flavor pref 0:0:0 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 17:13:46.816047 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-aaf0d908-5a09-4442-bcc9-70014f128534 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Image pref 0:0:0 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 17:13:46.816449 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-aaf0d908-5a09-4442-bcc9-70014f128534 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 17:13:46.824740 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-aaf0d908-5a09-4442-bcc9-70014f128534 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:46.825174 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-aaf0d908-5a09-4442-bcc9-70014f128534 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:46.825953 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-aaf0d908-5a09-4442-bcc9-70014f128534 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:46.826379 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-aaf0d908-5a09-4442-bcc9-70014f128534 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:46.842833 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.quota [None req-aaf0d908-5a09-4442-bcc9-70014f128534 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Getting quotas for project 70d941aa2c0e4b9eac9950e6e8237615. Resources: {'instances', 'cores', 'ram'} {{(pid=108417) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 17:13:46.846782 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.quota [None req-aaf0d908-5a09-4442-bcc9-70014f128534 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Getting quotas for user d11ab044b0ba41be87b038204b161d8f and project 70d941aa2c0e4b9eac9950e6e8237615. Resources: {'instances', 'cores', 'ram'} {{(pid=108417) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 17:13:46.857919 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-aaf0d908-5a09-4442-bcc9-70014f128534 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Going to run 1 instances... {{(pid=108417) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 17:13:46.860321 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-aaf0d908-5a09-4442-bcc9-70014f128534 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22ce6e29-f3a7-49f0-b93a-ddbffa14e44e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108417) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 17:13:46.904788 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-aaf0d908-5a09-4442-bcc9-70014f128534 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.651759 Sep 02 17:13:46.905410 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 414/885] 10.222.0.41 () {62 vars in 1188 bytes} [Thu Sep 2 17:13:46 2021] POST /compute/v2.1/servers => generated 402 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 02 17:13:46.916819 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-37713f29-28f2-417f-970a-9750c851de3d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:13:46.917629 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-37713f29-28f2-417f-970a-9750c851de3d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:46.979953 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-37713f29-28f2-417f-970a-9750c851de3d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:46.986837 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-37713f29-28f2-417f-970a-9750c851de3d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:46.988326 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-37713f29-28f2-417f-970a-9750c851de3d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:46.989683 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-37713f29-28f2-417f-970a-9750c851de3d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1280 microversion: 2.20 time: 0.077128 Sep 02 17:13:46.990223 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 472/886] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:13:46 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1280 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:13:47.513028 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-41ef8463-6b1d-4352-a163-e7f0b80966e1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:47.513904 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-41ef8463-6b1d-4352-a163-e7f0b80966e1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:47.520566 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-41ef8463-6b1d-4352-a163-e7f0b80966e1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:47.521079 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-41ef8463-6b1d-4352-a163-e7f0b80966e1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:47.521781 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-41ef8463-6b1d-4352-a163-e7f0b80966e1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:47.522211 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-41ef8463-6b1d-4352-a163-e7f0b80966e1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:47.645990 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-41ef8463-6b1d-4352-a163-e7f0b80966e1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.136621 Sep 02 17:13:47.646652 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 415/887] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:47 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:13:48.007174 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-ca8c09ed-8154-499f-ab8a-49e5221f132e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:13:48.007785 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-ca8c09ed-8154-499f-ab8a-49e5221f132e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:48.015119 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ca8c09ed-8154-499f-ab8a-49e5221f132e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:48.015569 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ca8c09ed-8154-499f-ab8a-49e5221f132e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:48.016333 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ca8c09ed-8154-499f-ab8a-49e5221f132e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:48.016768 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ca8c09ed-8154-499f-ab8a-49e5221f132e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:48.081362 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-ca8c09ed-8154-499f-ab8a-49e5221f132e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:48.091037 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-ca8c09ed-8154-499f-ab8a-49e5221f132e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:48.093060 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-ca8c09ed-8154-499f-ab8a-49e5221f132e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:48.094171 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-ca8c09ed-8154-499f-ab8a-49e5221f132e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1332 microversion: 2.20 time: 0.090734 Sep 02 17:13:48.094740 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 473/888] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:13:48 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1332 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:13:48.658880 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-48792bb7-9f1f-45ec-a344-4d08028396a2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:48.659964 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-48792bb7-9f1f-45ec-a344-4d08028396a2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:48.667619 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-48792bb7-9f1f-45ec-a344-4d08028396a2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:48.668164 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-48792bb7-9f1f-45ec-a344-4d08028396a2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:48.669006 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-48792bb7-9f1f-45ec-a344-4d08028396a2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:48.669508 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-48792bb7-9f1f-45ec-a344-4d08028396a2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:48.761967 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-48792bb7-9f1f-45ec-a344-4d08028396a2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.106963 Sep 02 17:13:48.762749 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 416/889] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:48 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:13:49.113987 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-4363f7ef-f655-441a-8750-f996368d5354 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:13:49.115015 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-4363f7ef-f655-441a-8750-f996368d5354 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:49.121079 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4363f7ef-f655-441a-8750-f996368d5354 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:49.121521 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4363f7ef-f655-441a-8750-f996368d5354 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:49.122286 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4363f7ef-f655-441a-8750-f996368d5354 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:49.122801 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4363f7ef-f655-441a-8750-f996368d5354 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:49.249745 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-4363f7ef-f655-441a-8750-f996368d5354 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:49.258307 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-4363f7ef-f655-441a-8750-f996368d5354 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:49.259838 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-4363f7ef-f655-441a-8750-f996368d5354 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:49.260964 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-4363f7ef-f655-441a-8750-f996368d5354 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1406 microversion: 2.20 time: 0.151199 Sep 02 17:13:49.261507 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 474/890] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:13:49 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:13:49.557869 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [req-7706575c-bd9c-474c-aaf1-b20752c2017c req-60b4be43-4109-40bf-998f-1a34de4c1104 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41c895d8-bf14-4b23-8657-02bf702bb50c", "tag": "88ce9e99-9c0c-4984-9fbe-83639825e7cc"}]} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:49.559374 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:13:49.559374 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: warnings.warn(msg) Sep 02 17:13:49.576328 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-7706575c-bd9c-474c-aaf1-b20752c2017c req-60b4be43-4109-40bf-998f-1a34de4c1104 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:49.576783 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-7706575c-bd9c-474c-aaf1-b20752c2017c req-60b4be43-4109-40bf-998f-1a34de4c1104 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:49.589942 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.compute.server_external_events [req-7706575c-bd9c-474c-aaf1-b20752c2017c req-60b4be43-4109-40bf-998f-1a34de4c1104 service nova] Creating event network-changed:88ce9e99-9c0c-4984-9fbe-83639825e7cc for instance 41c895d8-bf14-4b23-8657-02bf702bb50c on hv-cinder-80626 Sep 02 17:13:49.594849 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [req-7706575c-bd9c-474c-aaf1-b20752c2017c req-60b4be43-4109-40bf-998f-1a34de4c1104 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041095 Sep 02 17:13:49.595882 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 417/891] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:13:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:13:49.773302 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-b53bc09b-dde3-4deb-996e-727d9b68556b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:49.774254 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-b53bc09b-dde3-4deb-996e-727d9b68556b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:49.780539 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b53bc09b-dde3-4deb-996e-727d9b68556b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:49.780982 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b53bc09b-dde3-4deb-996e-727d9b68556b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:49.781748 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b53bc09b-dde3-4deb-996e-727d9b68556b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:49.782178 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b53bc09b-dde3-4deb-996e-727d9b68556b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:49.873513 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-b53bc09b-dde3-4deb-996e-727d9b68556b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.103665 Sep 02 17:13:49.877679 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 475/892] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:49 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:13:50.279256 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-31f8c706-29fb-422d-befd-5e54d6203a78 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:13:50.279951 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-31f8c706-29fb-422d-befd-5e54d6203a78 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:50.286134 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-31f8c706-29fb-422d-befd-5e54d6203a78 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:50.287103 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-31f8c706-29fb-422d-befd-5e54d6203a78 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:50.287899 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-31f8c706-29fb-422d-befd-5e54d6203a78 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:50.288354 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-31f8c706-29fb-422d-befd-5e54d6203a78 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:50.468306 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-31f8c706-29fb-422d-befd-5e54d6203a78 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:50.476452 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-31f8c706-29fb-422d-befd-5e54d6203a78 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:50.477936 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-31f8c706-29fb-422d-befd-5e54d6203a78 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:50.479063 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-31f8c706-29fb-422d-befd-5e54d6203a78 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1406 microversion: 2.20 time: 0.203964 Sep 02 17:13:50.479611 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 418/893] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:13:50 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1406 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:13:50.886309 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-a6288f07-c728-41fa-aed6-19849b967159 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:50.887326 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-a6288f07-c728-41fa-aed6-19849b967159 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:50.893760 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a6288f07-c728-41fa-aed6-19849b967159 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:50.894204 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a6288f07-c728-41fa-aed6-19849b967159 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:50.895017 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a6288f07-c728-41fa-aed6-19849b967159 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:50.895450 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a6288f07-c728-41fa-aed6-19849b967159 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:50.989973 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-a6288f07-c728-41fa-aed6-19849b967159 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.107564 Sep 02 17:13:50.990720 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 476/894] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:50 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:13:51.607050 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-282ebeae-2b99-4c47-bcc9-b6d72669d722 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:13:51.607731 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-282ebeae-2b99-4c47-bcc9-b6d72669d722 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:51.613513 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-282ebeae-2b99-4c47-bcc9-b6d72669d722 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:51.614208 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-282ebeae-2b99-4c47-bcc9-b6d72669d722 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:51.614983 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-282ebeae-2b99-4c47-bcc9-b6d72669d722 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:51.615413 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-282ebeae-2b99-4c47-bcc9-b6d72669d722 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:51.732270 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-282ebeae-2b99-4c47-bcc9-b6d72669d722 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:51.740119 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-282ebeae-2b99-4c47-bcc9-b6d72669d722 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:51.741592 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-282ebeae-2b99-4c47-bcc9-b6d72669d722 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:51.742685 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-282ebeae-2b99-4c47-bcc9-b6d72669d722 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1406 microversion: 2.20 time: 0.249616 Sep 02 17:13:51.743240 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 419/895] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:13:51 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1406 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:13:52.001640 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-c4844089-1ac4-4520-9ba2-1735e5eb057e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:52.002690 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-c4844089-1ac4-4520-9ba2-1735e5eb057e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:52.011234 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c4844089-1ac4-4520-9ba2-1735e5eb057e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:52.011974 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c4844089-1ac4-4520-9ba2-1735e5eb057e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:52.013150 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c4844089-1ac4-4520-9ba2-1735e5eb057e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:52.013847 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c4844089-1ac4-4520-9ba2-1735e5eb057e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:52.115763 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-c4844089-1ac4-4520-9ba2-1735e5eb057e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.117922 Sep 02 17:13:52.116441 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 477/896] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:51 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:13:52.760629 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-b94e5d00-b0fc-4b23-b137-6dd48457e086 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:13:52.761233 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-b94e5d00-b0fc-4b23-b137-6dd48457e086 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:52.767493 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b94e5d00-b0fc-4b23-b137-6dd48457e086 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:52.767943 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b94e5d00-b0fc-4b23-b137-6dd48457e086 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:52.768706 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b94e5d00-b0fc-4b23-b137-6dd48457e086 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:52.769134 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b94e5d00-b0fc-4b23-b137-6dd48457e086 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:52.893819 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-b94e5d00-b0fc-4b23-b137-6dd48457e086 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:52.901612 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-b94e5d00-b0fc-4b23-b137-6dd48457e086 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:52.903125 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-b94e5d00-b0fc-4b23-b137-6dd48457e086 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:52.904217 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-b94e5d00-b0fc-4b23-b137-6dd48457e086 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1406 microversion: 2.20 time: 0.147324 Sep 02 17:13:52.904770 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 420/897] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:13:52 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1406 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:13:53.127308 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-3d10c521-3756-4ca5-bfbe-3bb9d09d35ce tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:53.128305 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-3d10c521-3756-4ca5-bfbe-3bb9d09d35ce tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:53.135006 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3d10c521-3756-4ca5-bfbe-3bb9d09d35ce tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:53.135473 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3d10c521-3756-4ca5-bfbe-3bb9d09d35ce tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:53.136245 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3d10c521-3756-4ca5-bfbe-3bb9d09d35ce tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:53.136681 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3d10c521-3756-4ca5-bfbe-3bb9d09d35ce tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:53.228980 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-3d10c521-3756-4ca5-bfbe-3bb9d09d35ce tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.105201 Sep 02 17:13:53.230446 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 478/898] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:53 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:13:53.921300 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-8c824f40-2ec3-47cb-9d2e-ed14738d2033 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:13:53.922188 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-8c824f40-2ec3-47cb-9d2e-ed14738d2033 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:53.928716 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8c824f40-2ec3-47cb-9d2e-ed14738d2033 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:53.929160 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8c824f40-2ec3-47cb-9d2e-ed14738d2033 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:53.929904 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8c824f40-2ec3-47cb-9d2e-ed14738d2033 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:53.930331 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8c824f40-2ec3-47cb-9d2e-ed14738d2033 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:54.051205 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-8c824f40-2ec3-47cb-9d2e-ed14738d2033 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:54.059096 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-8c824f40-2ec3-47cb-9d2e-ed14738d2033 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:54.060575 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-8c824f40-2ec3-47cb-9d2e-ed14738d2033 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:54.061662 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-8c824f40-2ec3-47cb-9d2e-ed14738d2033 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1406 microversion: 2.20 time: 0.144052 Sep 02 17:13:54.062260 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 421/899] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:13:53 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1406 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:13:54.174854 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-54745c81-7372-4568-8ff8-9c5ec094ccdf tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-184176016", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1011419605", "security_groups": [{"name": "tempest-secgroup-smoke-502680709"}], "networks": [{"uuid": "9e77fdd1-8f89-4007-a52a-93ee8cbe395e"}], "block_device_mapping_v2": [{"uuid": "478ad011-a4ba-455f-8687-ebe7a2f93ecc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:54.278467 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.network.neutron [None req-54745c81-7372-4568-8ff8-9c5ec094ccdf tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] validate_networks() for [('9e77fdd1-8f89-4007-a52a-93ee8cbe395e', None, None, None, None, None)] {{(pid=108418) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 17:13:54.338613 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-48e2e865-9e59-48b2-8d83-08eeaedad02e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:54.339604 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-48e2e865-9e59-48b2-8d83-08eeaedad02e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:54.345584 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-48e2e865-9e59-48b2-8d83-08eeaedad02e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:54.346029 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-48e2e865-9e59-48b2-8d83-08eeaedad02e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:54.346880 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-48e2e865-9e59-48b2-8d83-08eeaedad02e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:54.347316 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-48e2e865-9e59-48b2-8d83-08eeaedad02e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:54.435138 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-48e2e865-9e59-48b2-8d83-08eeaedad02e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.197506 Sep 02 17:13:54.435856 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 422/900] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:54 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:13:54.688044 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-54745c81-7372-4568-8ff8-9c5ec094ccdf tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Flavor limits 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 17:13:54.688469 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-54745c81-7372-4568-8ff8-9c5ec094ccdf tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Image limits 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 17:13:54.688944 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-54745c81-7372-4568-8ff8-9c5ec094ccdf tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Flavor pref 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 17:13:54.689377 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-54745c81-7372-4568-8ff8-9c5ec094ccdf tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Image pref 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 17:13:54.689791 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-54745c81-7372-4568-8ff8-9c5ec094ccdf tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 17:13:54.698491 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-54745c81-7372-4568-8ff8-9c5ec094ccdf tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:54.698971 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-54745c81-7372-4568-8ff8-9c5ec094ccdf tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:54.699770 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-54745c81-7372-4568-8ff8-9c5ec094ccdf tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:54.700206 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-54745c81-7372-4568-8ff8-9c5ec094ccdf tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:54.716072 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.quota [None req-54745c81-7372-4568-8ff8-9c5ec094ccdf tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Getting quotas for project 1187a96ac5fd43ed8833b20d6e853409. Resources: {'instances', 'cores', 'ram'} {{(pid=108418) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 17:13:54.719857 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.quota [None req-54745c81-7372-4568-8ff8-9c5ec094ccdf tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Getting quotas for user bdfa1e28abf74f40b4d4456142c8f33e and project 1187a96ac5fd43ed8833b20d6e853409. Resources: {'instances', 'cores', 'ram'} {{(pid=108418) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 17:13:54.780494 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-54745c81-7372-4568-8ff8-9c5ec094ccdf tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Going to run 1 instances... {{(pid=108418) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 17:13:54.782732 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-54745c81-7372-4568-8ff8-9c5ec094ccdf tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='478ad011-a4ba-455f-8687-ebe7a2f93ecc',volume_size=None,volume_type=None)] {{(pid=108418) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 17:13:54.912605 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-54745c81-7372-4568-8ff8-9c5ec094ccdf tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.741231 Sep 02 17:13:54.913498 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 479/901] 10.222.0.41 () {60 vars in 1147 bytes} [Thu Sep 2 17:13:54 2021] POST /compute/v2.1/servers => generated 405 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 17:13:54.931231 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-f4edab4c-58cf-4190-b42a-eb0eaa9b1070 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:13:54.935451 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-f4edab4c-58cf-4190-b42a-eb0eaa9b1070 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:54.989159 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-f4edab4c-58cf-4190-b42a-eb0eaa9b1070 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:54.996318 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-f4edab4c-58cf-4190-b42a-eb0eaa9b1070 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1088 microversion: 2.1 time: 0.076064 Sep 02 17:13:54.996843 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 423/902] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:13:54 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1088 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:13:55.080864 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-981f3276-c2d9-4585-ad52-eaa37a0d219d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:13:55.081467 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-981f3276-c2d9-4585-ad52-eaa37a0d219d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:55.087662 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-981f3276-c2d9-4585-ad52-eaa37a0d219d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:55.088132 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-981f3276-c2d9-4585-ad52-eaa37a0d219d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:55.088945 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-981f3276-c2d9-4585-ad52-eaa37a0d219d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:55.089374 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-981f3276-c2d9-4585-ad52-eaa37a0d219d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:55.235353 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-981f3276-c2d9-4585-ad52-eaa37a0d219d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:55.245324 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-981f3276-c2d9-4585-ad52-eaa37a0d219d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:55.246858 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-981f3276-c2d9-4585-ad52-eaa37a0d219d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:55.248221 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-981f3276-c2d9-4585-ad52-eaa37a0d219d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1406 microversion: 2.20 time: 0.171838 Sep 02 17:13:55.248845 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 480/903] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:13:55 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:13:55.447145 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-6b729889-9469-494f-be87-563cda06c73e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:55.448838 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-6b729889-9469-494f-be87-563cda06c73e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:55.455876 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6b729889-9469-494f-be87-563cda06c73e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:55.456556 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6b729889-9469-494f-be87-563cda06c73e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:55.457494 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6b729889-9469-494f-be87-563cda06c73e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:55.458096 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6b729889-9469-494f-be87-563cda06c73e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:55.556710 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-6b729889-9469-494f-be87-563cda06c73e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.113063 Sep 02 17:13:55.557362 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 424/904] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:55 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:13:55.598588 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-a9729b98-f677-4c85-b54d-f0b368031b08 req-3441d2f4-5a4a-4e35-b743-f0a67dd6d9ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41c895d8-bf14-4b23-8657-02bf702bb50c", "name": "network-vif-plugged", "status": "completed", "tag": "88ce9e99-9c0c-4984-9fbe-83639825e7cc"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:55.600450 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:13:55.600450 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:13:55.608195 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-a9729b98-f677-4c85-b54d-f0b368031b08 req-3441d2f4-5a4a-4e35-b743-f0a67dd6d9ec service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:55.608195 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-a9729b98-f677-4c85-b54d-f0b368031b08 req-3441d2f4-5a4a-4e35-b743-f0a67dd6d9ec service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:55.620864 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-a9729b98-f677-4c85-b54d-f0b368031b08 req-3441d2f4-5a4a-4e35-b743-f0a67dd6d9ec service nova] Creating event network-vif-plugged:88ce9e99-9c0c-4984-9fbe-83639825e7cc for instance 41c895d8-bf14-4b23-8657-02bf702bb50c on hv-cinder-80626 Sep 02 17:13:55.625690 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-a9729b98-f677-4c85-b54d-f0b368031b08 req-3441d2f4-5a4a-4e35-b743-f0a67dd6d9ec service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030626 Sep 02 17:13:55.626492 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 481/905] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:13:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:13:56.013937 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-d9db0a46-a6df-41f7-959b-799632d37836 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:13:56.014662 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-d9db0a46-a6df-41f7-959b-799632d37836 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:56.021252 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d9db0a46-a6df-41f7-959b-799632d37836 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:56.021700 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d9db0a46-a6df-41f7-959b-799632d37836 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:56.022462 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d9db0a46-a6df-41f7-959b-799632d37836 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:56.022930 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d9db0a46-a6df-41f7-959b-799632d37836 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:56.082479 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-d9db0a46-a6df-41f7-959b-799632d37836 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:56.090115 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-d9db0a46-a6df-41f7-959b-799632d37836 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1186 microversion: 2.1 time: 0.080510 Sep 02 17:13:56.090729 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 425/906] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:13:56 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1186 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:13:56.266717 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-0ffedcb0-c378-4561-99f6-6d227b296b0c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:13:56.267467 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-0ffedcb0-c378-4561-99f6-6d227b296b0c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:56.273568 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-0ffedcb0-c378-4561-99f6-6d227b296b0c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:56.274011 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-0ffedcb0-c378-4561-99f6-6d227b296b0c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:56.274810 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-0ffedcb0-c378-4561-99f6-6d227b296b0c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:56.275254 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-0ffedcb0-c378-4561-99f6-6d227b296b0c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:56.406433 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-0ffedcb0-c378-4561-99f6-6d227b296b0c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:56.414741 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-0ffedcb0-c378-4561-99f6-6d227b296b0c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:56.416246 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-0ffedcb0-c378-4561-99f6-6d227b296b0c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:56.417389 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-0ffedcb0-c378-4561-99f6-6d227b296b0c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1406 microversion: 2.20 time: 0.154890 Sep 02 17:13:56.417933 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 482/907] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:13:56 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:13:56.568684 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-8b79aeed-9e15-4b8f-ad76-2d55ce68c63f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:56.569600 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-8b79aeed-9e15-4b8f-ad76-2d55ce68c63f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:56.575309 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8b79aeed-9e15-4b8f-ad76-2d55ce68c63f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:56.575756 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8b79aeed-9e15-4b8f-ad76-2d55ce68c63f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:56.576537 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8b79aeed-9e15-4b8f-ad76-2d55ce68c63f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:56.576972 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8b79aeed-9e15-4b8f-ad76-2d55ce68c63f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:56.671166 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-8b79aeed-9e15-4b8f-ad76-2d55ce68c63f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.105857 Sep 02 17:13:56.671830 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 426/908] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:56 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:13:57.107672 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-73f829a4-9aed-4535-af11-0600c08d4c9f tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:13:57.108677 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-73f829a4-9aed-4535-af11-0600c08d4c9f tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:57.115775 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-73f829a4-9aed-4535-af11-0600c08d4c9f tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:57.116517 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-73f829a4-9aed-4535-af11-0600c08d4c9f tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:57.117303 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-73f829a4-9aed-4535-af11-0600c08d4c9f tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:57.117930 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-73f829a4-9aed-4535-af11-0600c08d4c9f tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:57.265144 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-73f829a4-9aed-4535-af11-0600c08d4c9f tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:57.279823 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-73f829a4-9aed-4535-af11-0600c08d4c9f tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1271 microversion: 2.1 time: 0.174933 Sep 02 17:13:57.291630 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 483/909] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:13:57 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1271 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:13:57.434962 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-401066a2-953c-4501-9f9d-4f8c97cf98d3 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:13:57.435729 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-401066a2-953c-4501-9f9d-4f8c97cf98d3 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:57.443512 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-401066a2-953c-4501-9f9d-4f8c97cf98d3 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:57.444335 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-401066a2-953c-4501-9f9d-4f8c97cf98d3 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:57.445127 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-401066a2-953c-4501-9f9d-4f8c97cf98d3 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:57.445561 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-401066a2-953c-4501-9f9d-4f8c97cf98d3 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:57.676535 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-401066a2-953c-4501-9f9d-4f8c97cf98d3 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:57.683614 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-25a8ff7d-d60e-4339-b4fb-1450e5c8e0ff tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:57.684640 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-25a8ff7d-d60e-4339-b4fb-1450e5c8e0ff tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:57.689777 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-401066a2-953c-4501-9f9d-4f8c97cf98d3 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:57.690602 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-25a8ff7d-d60e-4339-b4fb-1450e5c8e0ff tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:57.691140 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-25a8ff7d-d60e-4339-b4fb-1450e5c8e0ff tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:57.691772 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-401066a2-953c-4501-9f9d-4f8c97cf98d3 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:57.691907 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-25a8ff7d-d60e-4339-b4fb-1450e5c8e0ff tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:57.692345 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-25a8ff7d-d60e-4339-b4fb-1450e5c8e0ff tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:57.693474 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-401066a2-953c-4501-9f9d-4f8c97cf98d3 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1599 microversion: 2.20 time: 0.262331 Sep 02 17:13:57.694031 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 427/910] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:13:57 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1599 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:13:57.712017 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-b58e940c-5ab6-49f5-853a-3c19cc37883b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:13:57.712507 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-b58e940c-5ab6-49f5-853a-3c19cc37883b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:57.718179 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b58e940c-5ab6-49f5-853a-3c19cc37883b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:57.718648 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b58e940c-5ab6-49f5-853a-3c19cc37883b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:57.719460 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b58e940c-5ab6-49f5-853a-3c19cc37883b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:57.719886 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b58e940c-5ab6-49f5-853a-3c19cc37883b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:57.790719 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-25a8ff7d-d60e-4339-b4fb-1450e5c8e0ff tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.110733 Sep 02 17:13:57.791648 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 484/911] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:57 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:13:57.852318 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-b58e940c-5ab6-49f5-853a-3c19cc37883b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.143906 Sep 02 17:13:57.853336 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 428/912] 10.222.0.41 () {60 vars in 1316 bytes} [Thu Sep 2 17:13:57 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/os-interface => generated 285 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:13:58.059323 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-8584e9e7-643a-4a04-8ba2-b3ad98d437b3 req-0b9e55be-0b86-4205-bb13-031f6eb64434 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cea6ec2a-41c7-41c5-8471-3da2ba130315", "tag": "f0347608-2078-4ebd-b282-53b22f166ac6"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:58.060800 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:13:58.060800 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:13:58.072480 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-8584e9e7-643a-4a04-8ba2-b3ad98d437b3 req-0b9e55be-0b86-4205-bb13-031f6eb64434 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:58.072857 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-8584e9e7-643a-4a04-8ba2-b3ad98d437b3 req-0b9e55be-0b86-4205-bb13-031f6eb64434 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:58.094592 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-8584e9e7-643a-4a04-8ba2-b3ad98d437b3 req-0b9e55be-0b86-4205-bb13-031f6eb64434 service nova] Creating event network-changed:f0347608-2078-4ebd-b282-53b22f166ac6 for instance cea6ec2a-41c7-41c5-8471-3da2ba130315 on hv-cinder-80626 Sep 02 17:13:58.103906 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-8584e9e7-643a-4a04-8ba2-b3ad98d437b3 req-0b9e55be-0b86-4205-bb13-031f6eb64434 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048313 Sep 02 17:13:58.105305 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 485/913] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:13:58 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:13:58.299950 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-9eeb0d84-2df9-43f2-af82-a8fb32f4aa7e tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:13:58.301392 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-9eeb0d84-2df9-43f2-af82-a8fb32f4aa7e tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:58.311804 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9eeb0d84-2df9-43f2-af82-a8fb32f4aa7e tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:58.312521 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9eeb0d84-2df9-43f2-af82-a8fb32f4aa7e tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:58.313427 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9eeb0d84-2df9-43f2-af82-a8fb32f4aa7e tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:58.313866 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9eeb0d84-2df9-43f2-af82-a8fb32f4aa7e tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:58.559814 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-9eeb0d84-2df9-43f2-af82-a8fb32f4aa7e tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:58.567938 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-9eeb0d84-2df9-43f2-af82-a8fb32f4aa7e tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1259 microversion: 2.1 time: 0.272538 Sep 02 17:13:58.568762 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 429/914] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:13:58 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1259 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:13:58.805353 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-7dc4e3c3-ff39-41ba-b50c-4e1e57b317a1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:58.807188 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-7dc4e3c3-ff39-41ba-b50c-4e1e57b317a1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:58.813363 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7dc4e3c3-ff39-41ba-b50c-4e1e57b317a1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:58.813835 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7dc4e3c3-ff39-41ba-b50c-4e1e57b317a1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:58.814613 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7dc4e3c3-ff39-41ba-b50c-4e1e57b317a1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:58.815059 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7dc4e3c3-ff39-41ba-b50c-4e1e57b317a1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:58.925887 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-7dc4e3c3-ff39-41ba-b50c-4e1e57b317a1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.126128 Sep 02 17:13:58.927335 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 486/915] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:58 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:13:59.063203 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-36e15007-b26f-4d93-9796-62da9124584a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:59.064128 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-36e15007-b26f-4d93-9796-62da9124584a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:59.069369 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-bad041bb-48a5-4c6d-80b7-be925cd7d566 req-64dfa816-3cc7-42c0-8166-e2f574277544 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41c895d8-bf14-4b23-8657-02bf702bb50c", "tag": "88ce9e99-9c0c-4984-9fbe-83639825e7cc"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:59.070902 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:13:59.070902 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:13:59.078026 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-36e15007-b26f-4d93-9796-62da9124584a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:59.078593 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-bad041bb-48a5-4c6d-80b7-be925cd7d566 req-64dfa816-3cc7-42c0-8166-e2f574277544 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:59.078791 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-36e15007-b26f-4d93-9796-62da9124584a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:59.079388 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-bad041bb-48a5-4c6d-80b7-be925cd7d566 req-64dfa816-3cc7-42c0-8166-e2f574277544 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:59.079524 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-36e15007-b26f-4d93-9796-62da9124584a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:59.079897 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-36e15007-b26f-4d93-9796-62da9124584a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:59.092193 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-bad041bb-48a5-4c6d-80b7-be925cd7d566 req-64dfa816-3cc7-42c0-8166-e2f574277544 service nova] Creating event network-changed:88ce9e99-9c0c-4984-9fbe-83639825e7cc for instance 41c895d8-bf14-4b23-8657-02bf702bb50c on hv-cinder-80626 Sep 02 17:13:59.097732 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-bad041bb-48a5-4c6d-80b7-be925cd7d566 req-64dfa816-3cc7-42c0-8166-e2f574277544 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032409 Sep 02 17:13:59.099435 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 487/916] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:13:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:13:59.192616 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-36e15007-b26f-4d93-9796-62da9124584a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action" status: 200 len: 14 microversion: 2.20 time: 0.132522 Sep 02 17:13:59.193537 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 430/917] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:13:59 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:13:59.586279 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-42dc7417-aba3-417e-8f61-ded49590d8d7 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:13:59.587005 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-42dc7417-aba3-417e-8f61-ded49590d8d7 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:59.593262 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-42dc7417-aba3-417e-8f61-ded49590d8d7 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:59.593987 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-42dc7417-aba3-417e-8f61-ded49590d8d7 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:59.594948 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-42dc7417-aba3-417e-8f61-ded49590d8d7 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:59.595542 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-42dc7417-aba3-417e-8f61-ded49590d8d7 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:59.753230 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-42dc7417-aba3-417e-8f61-ded49590d8d7 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:13:59.761070 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-42dc7417-aba3-417e-8f61-ded49590d8d7 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1259 microversion: 2.1 time: 0.179447 Sep 02 17:13:59.761799 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 488/918] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:13:59 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:13:59.938241 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-fd54680e-adb9-4b5b-804b-0732d5840e85 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:13:59.939269 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-fd54680e-adb9-4b5b-804b-0732d5840e85 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:13:59.946557 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fd54680e-adb9-4b5b-804b-0732d5840e85 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:59.947057 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fd54680e-adb9-4b5b-804b-0732d5840e85 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:13:59.947839 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fd54680e-adb9-4b5b-804b-0732d5840e85 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:13:59.948274 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fd54680e-adb9-4b5b-804b-0732d5840e85 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:00.047493 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-fd54680e-adb9-4b5b-804b-0732d5840e85 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.113021 Sep 02 17:14:00.048144 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 431/919] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:13:59 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:00.203369 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-34a5ad80-f8bc-4496-8afe-27e31015a2f0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:00.204193 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-34a5ad80-f8bc-4496-8afe-27e31015a2f0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:00.210568 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-34a5ad80-f8bc-4496-8afe-27e31015a2f0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:00.211049 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-34a5ad80-f8bc-4496-8afe-27e31015a2f0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:00.211822 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-34a5ad80-f8bc-4496-8afe-27e31015a2f0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:00.212265 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-34a5ad80-f8bc-4496-8afe-27e31015a2f0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:00.296442 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-34a5ad80-f8bc-4496-8afe-27e31015a2f0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action" status: 200 len: 14 microversion: 2.20 time: 0.096684 Sep 02 17:14:00.297068 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 489/920] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:14:00 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:14:00.778870 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-669ef420-0e0a-4b78-b980-2bbbc14edca5 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:14:00.779569 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-669ef420-0e0a-4b78-b980-2bbbc14edca5 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:00.785979 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-669ef420-0e0a-4b78-b980-2bbbc14edca5 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:00.786946 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-669ef420-0e0a-4b78-b980-2bbbc14edca5 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:00.787782 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-669ef420-0e0a-4b78-b980-2bbbc14edca5 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:00.788134 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-669ef420-0e0a-4b78-b980-2bbbc14edca5 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:00.910422 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-669ef420-0e0a-4b78-b980-2bbbc14edca5 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:00.918680 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-669ef420-0e0a-4b78-b980-2bbbc14edca5 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1259 microversion: 2.1 time: 0.143857 Sep 02 17:14:00.919244 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 432/921] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:14:00 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1259 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:14:01.060016 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-521f4ac8-4bd6-4ea5-98af-7b55e9ca4952 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:01.061001 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-521f4ac8-4bd6-4ea5-98af-7b55e9ca4952 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:01.067502 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-521f4ac8-4bd6-4ea5-98af-7b55e9ca4952 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:01.067945 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-521f4ac8-4bd6-4ea5-98af-7b55e9ca4952 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:01.068705 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-521f4ac8-4bd6-4ea5-98af-7b55e9ca4952 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:01.069136 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-521f4ac8-4bd6-4ea5-98af-7b55e9ca4952 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:01.153937 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-521f4ac8-4bd6-4ea5-98af-7b55e9ca4952 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.097722 Sep 02 17:14:01.154575 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 490/922] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:01 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:01.307125 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-3d367997-84db-4b5e-b227-9c613afa5641 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:01.308030 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-3d367997-84db-4b5e-b227-9c613afa5641 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:01.313852 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3d367997-84db-4b5e-b227-9c613afa5641 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:01.314235 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3d367997-84db-4b5e-b227-9c613afa5641 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:01.315040 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3d367997-84db-4b5e-b227-9c613afa5641 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:01.315472 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3d367997-84db-4b5e-b227-9c613afa5641 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:01.404205 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-3d367997-84db-4b5e-b227-9c613afa5641 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action" status: 200 len: 14 microversion: 2.20 time: 0.100561 Sep 02 17:14:01.404855 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 433/923] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:14:01 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:14:01.935369 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-061077ce-efe1-4119-ab99-67535362831a tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:14:01.936058 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-061077ce-efe1-4119-ab99-67535362831a tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:01.943433 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-061077ce-efe1-4119-ab99-67535362831a tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:01.943664 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-061077ce-efe1-4119-ab99-67535362831a tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:01.944421 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-061077ce-efe1-4119-ab99-67535362831a tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:01.944849 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-061077ce-efe1-4119-ab99-67535362831a tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:02.067440 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-061077ce-efe1-4119-ab99-67535362831a tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:02.074914 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-061077ce-efe1-4119-ab99-67535362831a tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1259 microversion: 2.1 time: 0.143475 Sep 02 17:14:02.075486 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 491/924] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:14:01 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1259 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:14:02.166772 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-481c539a-fd62-41e2-8bf7-141dfb7584a0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:02.167756 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-481c539a-fd62-41e2-8bf7-141dfb7584a0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:02.174127 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-481c539a-fd62-41e2-8bf7-141dfb7584a0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:02.174568 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-481c539a-fd62-41e2-8bf7-141dfb7584a0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:02.175354 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-481c539a-fd62-41e2-8bf7-141dfb7584a0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:02.175784 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-481c539a-fd62-41e2-8bf7-141dfb7584a0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:02.265564 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-481c539a-fd62-41e2-8bf7-141dfb7584a0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.102706 Sep 02 17:14:02.266230 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 434/925] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:02 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:02.415498 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-4907cb73-fe4d-4864-a0e3-2a9f57ba91e8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:02.416393 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-4907cb73-fe4d-4864-a0e3-2a9f57ba91e8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:02.422175 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4907cb73-fe4d-4864-a0e3-2a9f57ba91e8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:02.422608 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4907cb73-fe4d-4864-a0e3-2a9f57ba91e8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:02.423391 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4907cb73-fe4d-4864-a0e3-2a9f57ba91e8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:02.423819 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4907cb73-fe4d-4864-a0e3-2a9f57ba91e8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:02.506293 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-4907cb73-fe4d-4864-a0e3-2a9f57ba91e8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action" status: 200 len: 14 microversion: 2.20 time: 0.094868 Sep 02 17:14:02.506839 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 492/926] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:14:02 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:14:03.091554 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-aff26a45-8fad-4dd6-8f7d-0f36984c38f2 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:14:03.092246 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-aff26a45-8fad-4dd6-8f7d-0f36984c38f2 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:03.098747 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-aff26a45-8fad-4dd6-8f7d-0f36984c38f2 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:03.099200 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-aff26a45-8fad-4dd6-8f7d-0f36984c38f2 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:03.099969 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-aff26a45-8fad-4dd6-8f7d-0f36984c38f2 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:03.100400 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-aff26a45-8fad-4dd6-8f7d-0f36984c38f2 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:03.218578 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-aff26a45-8fad-4dd6-8f7d-0f36984c38f2 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:03.226364 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-aff26a45-8fad-4dd6-8f7d-0f36984c38f2 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1259 microversion: 2.1 time: 0.138756 Sep 02 17:14:03.226948 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 435/927] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:14:03 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1259 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:14:03.277943 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-2c2842cf-0395-4e02-b52c-840dfbb95483 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:03.278960 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-2c2842cf-0395-4e02-b52c-840dfbb95483 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:03.285384 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2c2842cf-0395-4e02-b52c-840dfbb95483 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:03.285835 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2c2842cf-0395-4e02-b52c-840dfbb95483 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:03.287313 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2c2842cf-0395-4e02-b52c-840dfbb95483 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:03.287750 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2c2842cf-0395-4e02-b52c-840dfbb95483 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:03.382098 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-2c2842cf-0395-4e02-b52c-840dfbb95483 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.108038 Sep 02 17:14:03.382740 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 493/928] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:03 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:03.516724 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-3647155f-afbe-4d4c-aefd-c8005f9a2c73 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:03.517547 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-3647155f-afbe-4d4c-aefd-c8005f9a2c73 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:03.524011 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3647155f-afbe-4d4c-aefd-c8005f9a2c73 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:03.524454 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3647155f-afbe-4d4c-aefd-c8005f9a2c73 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:03.525212 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3647155f-afbe-4d4c-aefd-c8005f9a2c73 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:03.525645 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3647155f-afbe-4d4c-aefd-c8005f9a2c73 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:03.622007 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-3647155f-afbe-4d4c-aefd-c8005f9a2c73 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action" status: 200 len: 14 microversion: 2.20 time: 0.108901 Sep 02 17:14:03.622642 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 436/929] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:14:03 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:14:04.244479 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-4ad083d2-d639-438d-81c4-699c17f4c426 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:14:04.245195 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-4ad083d2-d639-438d-81c4-699c17f4c426 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:04.253837 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4ad083d2-d639-438d-81c4-699c17f4c426 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:04.254642 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4ad083d2-d639-438d-81c4-699c17f4c426 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:04.256032 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4ad083d2-d639-438d-81c4-699c17f4c426 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:04.256796 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4ad083d2-d639-438d-81c4-699c17f4c426 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:04.377215 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-4ad083d2-d639-438d-81c4-699c17f4c426 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:04.384491 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-4ad083d2-d639-438d-81c4-699c17f4c426 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1259 microversion: 2.1 time: 0.144080 Sep 02 17:14:04.385039 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 494/930] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:14:04 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1259 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:14:04.393738 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-2504b439-3b76-4dac-9090-38dcdb6f7f94 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:04.394752 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-2504b439-3b76-4dac-9090-38dcdb6f7f94 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:04.401126 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2504b439-3b76-4dac-9090-38dcdb6f7f94 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:04.401573 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2504b439-3b76-4dac-9090-38dcdb6f7f94 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:04.402337 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2504b439-3b76-4dac-9090-38dcdb6f7f94 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:04.402814 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2504b439-3b76-4dac-9090-38dcdb6f7f94 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:04.489195 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-2504b439-3b76-4dac-9090-38dcdb6f7f94 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.099012 Sep 02 17:14:04.490559 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 437/931] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:04 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:04.633005 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-92db3b1b-eb49-4a38-b906-75ff24c67d1b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:04.633912 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-92db3b1b-eb49-4a38-b906-75ff24c67d1b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:04.639807 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-92db3b1b-eb49-4a38-b906-75ff24c67d1b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:04.640254 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-92db3b1b-eb49-4a38-b906-75ff24c67d1b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:04.641011 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-92db3b1b-eb49-4a38-b906-75ff24c67d1b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:04.641445 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-92db3b1b-eb49-4a38-b906-75ff24c67d1b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:04.728407 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-92db3b1b-eb49-4a38-b906-75ff24c67d1b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action" status: 200 len: 14 microversion: 2.20 time: 0.099130 Sep 02 17:14:04.729002 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 495/932] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:14:04 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:14:05.401538 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-ecdd23cd-0667-4d14-b705-86749f5b327d tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:14:05.402258 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-ecdd23cd-0667-4d14-b705-86749f5b327d tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:05.409823 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ecdd23cd-0667-4d14-b705-86749f5b327d tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:05.410250 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ecdd23cd-0667-4d14-b705-86749f5b327d tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:05.411111 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ecdd23cd-0667-4d14-b705-86749f5b327d tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:05.411542 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ecdd23cd-0667-4d14-b705-86749f5b327d tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:05.502195 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-1925a203-acdc-4e2d-bbd8-9ef0baaaf694 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:05.503359 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-1925a203-acdc-4e2d-bbd8-9ef0baaaf694 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:05.510409 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1925a203-acdc-4e2d-bbd8-9ef0baaaf694 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:05.510979 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1925a203-acdc-4e2d-bbd8-9ef0baaaf694 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:05.511832 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1925a203-acdc-4e2d-bbd8-9ef0baaaf694 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:05.512273 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1925a203-acdc-4e2d-bbd8-9ef0baaaf694 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:05.531539 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-ecdd23cd-0667-4d14-b705-86749f5b327d tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:05.539796 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-ecdd23cd-0667-4d14-b705-86749f5b327d tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1259 microversion: 2.1 time: 0.142257 Sep 02 17:14:05.540577 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 438/933] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:14:05 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1259 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:14:05.598325 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-1925a203-acdc-4e2d-bbd8-9ef0baaaf694 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.099983 Sep 02 17:14:05.599025 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 496/934] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:05 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:14:05.740532 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-7e53dbe8-590d-4c9a-b5b8-227671af1004 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:05.741398 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-7e53dbe8-590d-4c9a-b5b8-227671af1004 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:05.747224 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7e53dbe8-590d-4c9a-b5b8-227671af1004 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:05.747674 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7e53dbe8-590d-4c9a-b5b8-227671af1004 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:05.748435 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7e53dbe8-590d-4c9a-b5b8-227671af1004 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:05.748869 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7e53dbe8-590d-4c9a-b5b8-227671af1004 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:05.829171 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-7e53dbe8-590d-4c9a-b5b8-227671af1004 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action" status: 200 len: 14 microversion: 2.20 time: 0.093176 Sep 02 17:14:05.829972 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 439/935] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:14:05 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:14:06.557689 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-7e84ab48-a8c6-463b-88b0-504ab81fa592 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:14:06.558376 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-7e84ab48-a8c6-463b-88b0-504ab81fa592 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:06.565077 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7e84ab48-a8c6-463b-88b0-504ab81fa592 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:06.565548 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7e84ab48-a8c6-463b-88b0-504ab81fa592 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:06.566301 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7e84ab48-a8c6-463b-88b0-504ab81fa592 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:06.566757 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7e84ab48-a8c6-463b-88b0-504ab81fa592 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:06.610847 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-4e1b0fda-8315-4e58-ab3f-7f6a81d4336b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:06.611932 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-4e1b0fda-8315-4e58-ab3f-7f6a81d4336b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:06.619868 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4e1b0fda-8315-4e58-ab3f-7f6a81d4336b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:06.620447 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4e1b0fda-8315-4e58-ab3f-7f6a81d4336b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:06.621229 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4e1b0fda-8315-4e58-ab3f-7f6a81d4336b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:06.621665 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4e1b0fda-8315-4e58-ab3f-7f6a81d4336b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:06.688326 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-7e84ab48-a8c6-463b-88b0-504ab81fa592 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:06.695508 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-7e84ab48-a8c6-463b-88b0-504ab81fa592 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1259 microversion: 2.1 time: 0.141825 Sep 02 17:14:06.696057 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 497/936] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:14:06 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1259 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:14:06.715447 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-4e1b0fda-8315-4e58-ab3f-7f6a81d4336b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.108663 Sep 02 17:14:06.716117 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 440/937] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:06 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:14:06.840330 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-8d769aaf-2c39-47f4-b806-1e73d6cd88ae tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:06.841163 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-8d769aaf-2c39-47f4-b806-1e73d6cd88ae tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:06.847278 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8d769aaf-2c39-47f4-b806-1e73d6cd88ae tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:06.847732 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8d769aaf-2c39-47f4-b806-1e73d6cd88ae tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:06.848500 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8d769aaf-2c39-47f4-b806-1e73d6cd88ae tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:06.848970 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8d769aaf-2c39-47f4-b806-1e73d6cd88ae tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:06.936285 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-8d769aaf-2c39-47f4-b806-1e73d6cd88ae tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action" status: 200 len: 14 microversion: 2.20 time: 0.099576 Sep 02 17:14:06.936913 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 498/938] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:14:06 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:14:07.712819 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-a9f3b39c-37fb-4167-8dbf-d90adb5987b8 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:14:07.713510 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-a9f3b39c-37fb-4167-8dbf-d90adb5987b8 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:07.719987 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a9f3b39c-37fb-4167-8dbf-d90adb5987b8 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:07.720437 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a9f3b39c-37fb-4167-8dbf-d90adb5987b8 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:07.721241 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a9f3b39c-37fb-4167-8dbf-d90adb5987b8 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:07.721676 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a9f3b39c-37fb-4167-8dbf-d90adb5987b8 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:07.729132 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-6052c14f-be55-4648-a207-4e387897a337 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:07.730162 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-6052c14f-be55-4648-a207-4e387897a337 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:07.736949 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6052c14f-be55-4648-a207-4e387897a337 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:07.737391 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6052c14f-be55-4648-a207-4e387897a337 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:07.738155 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6052c14f-be55-4648-a207-4e387897a337 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:07.738581 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6052c14f-be55-4648-a207-4e387897a337 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:07.825996 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-6052c14f-be55-4648-a207-4e387897a337 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.101997 Sep 02 17:14:07.830246 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 499/939] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:07 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:14:07.847284 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-a9f3b39c-37fb-4167-8dbf-d90adb5987b8 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:07.854506 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-a9f3b39c-37fb-4167-8dbf-d90adb5987b8 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1259 microversion: 2.1 time: 0.145808 Sep 02 17:14:07.855084 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 441/940] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:14:07 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1259 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:14:07.947644 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-a3c63ff8-c2b7-417c-9702-bd3479b7acb2 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:07.948626 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-a3c63ff8-c2b7-417c-9702-bd3479b7acb2 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:07.955577 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a3c63ff8-c2b7-417c-9702-bd3479b7acb2 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:07.956034 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a3c63ff8-c2b7-417c-9702-bd3479b7acb2 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:07.956877 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a3c63ff8-c2b7-417c-9702-bd3479b7acb2 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:07.957318 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a3c63ff8-c2b7-417c-9702-bd3479b7acb2 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:08.051573 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-a3c63ff8-c2b7-417c-9702-bd3479b7acb2 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action" status: 200 len: 14 microversion: 2.20 time: 0.108400 Sep 02 17:14:08.055261 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 500/941] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:14:07 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:14:08.838242 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-f96750c2-82db-413e-91ae-e5b109b2aad8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:08.839226 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-f96750c2-82db-413e-91ae-e5b109b2aad8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:08.845763 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f96750c2-82db-413e-91ae-e5b109b2aad8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:08.846201 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f96750c2-82db-413e-91ae-e5b109b2aad8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:08.846983 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f96750c2-82db-413e-91ae-e5b109b2aad8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:08.847416 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f96750c2-82db-413e-91ae-e5b109b2aad8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:08.873231 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-cf7c78c2-6adb-4251-85f2-7961e6453e58 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:14:08.873920 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-cf7c78c2-6adb-4251-85f2-7961e6453e58 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:08.880276 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cf7c78c2-6adb-4251-85f2-7961e6453e58 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:08.880714 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cf7c78c2-6adb-4251-85f2-7961e6453e58 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:08.881467 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cf7c78c2-6adb-4251-85f2-7961e6453e58 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:08.881893 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cf7c78c2-6adb-4251-85f2-7961e6453e58 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:08.938246 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-f96750c2-82db-413e-91ae-e5b109b2aad8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.103671 Sep 02 17:14:08.939147 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 442/942] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:08 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:09.006090 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-cf7c78c2-6adb-4251-85f2-7961e6453e58 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:09.013333 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-cf7c78c2-6adb-4251-85f2-7961e6453e58 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1259 microversion: 2.1 time: 0.144102 Sep 02 17:14:09.013887 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 501/943] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:14:08 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1259 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:14:09.063390 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-014d5e93-4a1d-4316-a743-f66be18ec8b9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:09.064414 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-014d5e93-4a1d-4316-a743-f66be18ec8b9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:09.070821 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-014d5e93-4a1d-4316-a743-f66be18ec8b9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:09.071264 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-014d5e93-4a1d-4316-a743-f66be18ec8b9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:09.072019 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-014d5e93-4a1d-4316-a743-f66be18ec8b9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:09.072448 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-014d5e93-4a1d-4316-a743-f66be18ec8b9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:09.157520 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-014d5e93-4a1d-4316-a743-f66be18ec8b9 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action" status: 200 len: 14 microversion: 2.20 time: 0.098036 Sep 02 17:14:09.158037 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 443/944] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:14:09 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:14:09.656174 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-41915ae2-9bb0-4bbc-9de7-e674c1f78e78 req-969403da-1d93-4668-bb79-fad4d188ef7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cea6ec2a-41c7-41c5-8471-3da2ba130315", "name": "network-vif-plugged", "status": "completed", "tag": "f0347608-2078-4ebd-b282-53b22f166ac6"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:09.657666 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:14:09.657666 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:14:09.667657 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-41915ae2-9bb0-4bbc-9de7-e674c1f78e78 req-969403da-1d93-4668-bb79-fad4d188ef7c service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:09.668108 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-41915ae2-9bb0-4bbc-9de7-e674c1f78e78 req-969403da-1d93-4668-bb79-fad4d188ef7c service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:09.679478 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-41915ae2-9bb0-4bbc-9de7-e674c1f78e78 req-969403da-1d93-4668-bb79-fad4d188ef7c service nova] Creating event network-vif-plugged:f0347608-2078-4ebd-b282-53b22f166ac6 for instance cea6ec2a-41c7-41c5-8471-3da2ba130315 on hv-cinder-80626 Sep 02 17:14:09.685030 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-41915ae2-9bb0-4bbc-9de7-e674c1f78e78 req-969403da-1d93-4668-bb79-fad4d188ef7c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031943 Sep 02 17:14:09.692603 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 502/945] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:14:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:14:09.951201 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-d76f5fd1-7790-489d-844e-588e3053c7d2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:09.952307 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-d76f5fd1-7790-489d-844e-588e3053c7d2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:09.959338 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d76f5fd1-7790-489d-844e-588e3053c7d2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:09.959796 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d76f5fd1-7790-489d-844e-588e3053c7d2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:09.960562 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d76f5fd1-7790-489d-844e-588e3053c7d2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:09.961517 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d76f5fd1-7790-489d-844e-588e3053c7d2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:10.029820 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-63a40511-d3ab-47a9-aeb1-25deb1f3381b tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:14:10.030514 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-63a40511-d3ab-47a9-aeb1-25deb1f3381b tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:10.037515 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-63a40511-d3ab-47a9-aeb1-25deb1f3381b tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:10.037949 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-63a40511-d3ab-47a9-aeb1-25deb1f3381b tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:10.038733 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-63a40511-d3ab-47a9-aeb1-25deb1f3381b tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:10.039164 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-63a40511-d3ab-47a9-aeb1-25deb1f3381b tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:10.156706 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-63a40511-d3ab-47a9-aeb1-25deb1f3381b tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:10.164649 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-63a40511-d3ab-47a9-aeb1-25deb1f3381b tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1259 microversion: 2.1 time: 0.139048 Sep 02 17:14:10.165205 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 503/946] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:14:10 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1259 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:14:10.169482 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-c1183e1b-9517-4f33-997c-5cc73ae8a34a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:10.170359 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-c1183e1b-9517-4f33-997c-5cc73ae8a34a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:10.175794 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c1183e1b-9517-4f33-997c-5cc73ae8a34a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:10.176231 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c1183e1b-9517-4f33-997c-5cc73ae8a34a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:10.176986 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c1183e1b-9517-4f33-997c-5cc73ae8a34a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:10.177413 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c1183e1b-9517-4f33-997c-5cc73ae8a34a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:10.328664 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-d76f5fd1-7790-489d-844e-588e3053c7d2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.381418 Sep 02 17:14:10.329335 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 444/947] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:09 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:10.353837 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-c1183e1b-9517-4f33-997c-5cc73ae8a34a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action" status: 200 len: 7815 microversion: 2.20 time: 0.187405 Sep 02 17:14:10.354507 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 504/948] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:14:10 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action => generated 7815 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:14:11.182674 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-57573393-7ddc-4c29-b504-ff7183e55b83 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:14:11.183367 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-57573393-7ddc-4c29-b504-ff7183e55b83 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:11.189714 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-57573393-7ddc-4c29-b504-ff7183e55b83 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:11.190159 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-57573393-7ddc-4c29-b504-ff7183e55b83 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:11.190949 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-57573393-7ddc-4c29-b504-ff7183e55b83 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:11.191381 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-57573393-7ddc-4c29-b504-ff7183e55b83 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:11.314407 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-57573393-7ddc-4c29-b504-ff7183e55b83 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:11.321621 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-57573393-7ddc-4c29-b504-ff7183e55b83 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1259 microversion: 2.1 time: 0.143808 Sep 02 17:14:11.322174 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 445/949] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:14:11 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1259 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:14:11.341150 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-c48811e9-6902-47dd-9ac5-c5eb26ef21ee tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:11.342192 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-c48811e9-6902-47dd-9ac5-c5eb26ef21ee tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:11.348691 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c48811e9-6902-47dd-9ac5-c5eb26ef21ee tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:11.349757 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c48811e9-6902-47dd-9ac5-c5eb26ef21ee tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:11.350530 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c48811e9-6902-47dd-9ac5-c5eb26ef21ee tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:11.351396 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c48811e9-6902-47dd-9ac5-c5eb26ef21ee tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:11.365098 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-71298fdc-4cbb-409f-9a1c-682ddd18337e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:11.365998 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-71298fdc-4cbb-409f-9a1c-682ddd18337e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:11.371708 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-71298fdc-4cbb-409f-9a1c-682ddd18337e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:11.372157 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-71298fdc-4cbb-409f-9a1c-682ddd18337e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:11.372921 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-71298fdc-4cbb-409f-9a1c-682ddd18337e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:11.373362 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-71298fdc-4cbb-409f-9a1c-682ddd18337e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:11.449239 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-c48811e9-6902-47dd-9ac5-c5eb26ef21ee tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.111880 Sep 02 17:14:11.449890 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 505/950] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:11 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:14:11.478685 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-71298fdc-4cbb-409f-9a1c-682ddd18337e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action" status: 200 len: 15025 microversion: 2.20 time: 0.117406 Sep 02 17:14:11.479312 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 446/951] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:14:11 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action => generated 15025 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:14:12.338409 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-512805e8-ae84-4bba-82fa-b67970cb0586 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:14:12.339162 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-512805e8-ae84-4bba-82fa-b67970cb0586 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:12.345671 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-512805e8-ae84-4bba-82fa-b67970cb0586 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:12.346208 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-512805e8-ae84-4bba-82fa-b67970cb0586 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:12.346905 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-512805e8-ae84-4bba-82fa-b67970cb0586 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:12.347347 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-512805e8-ae84-4bba-82fa-b67970cb0586 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:12.461610 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-a684f3a0-5f92-4f99-bf22-05c2ce81d0f9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:12.462649 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-a684f3a0-5f92-4f99-bf22-05c2ce81d0f9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:12.469018 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-512805e8-ae84-4bba-82fa-b67970cb0586 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:12.469183 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a684f3a0-5f92-4f99-bf22-05c2ce81d0f9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:12.469492 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a684f3a0-5f92-4f99-bf22-05c2ce81d0f9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:12.470254 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a684f3a0-5f92-4f99-bf22-05c2ce81d0f9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:12.470707 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a684f3a0-5f92-4f99-bf22-05c2ce81d0f9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:12.476885 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-512805e8-ae84-4bba-82fa-b67970cb0586 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1443 microversion: 2.1 time: 0.142468 Sep 02 17:14:12.477478 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 506/952] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:14:12 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1443 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:14:12.489606 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-6007b15e-6c8a-4748-9536-739314f8004a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:12.491116 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-6007b15e-6c8a-4748-9536-739314f8004a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:12.496909 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6007b15e-6c8a-4748-9536-739314f8004a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:12.497454 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6007b15e-6c8a-4748-9536-739314f8004a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:12.498922 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6007b15e-6c8a-4748-9536-739314f8004a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:12.499364 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6007b15e-6c8a-4748-9536-739314f8004a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:12.586250 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-a684f3a0-5f92-4f99-bf22-05c2ce81d0f9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.128503 Sep 02 17:14:12.586909 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 447/953] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:12 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:14:12.591641 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-e1f348ee-91e4-49eb-a3c8-9bd1baf230ff tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:14:12.592350 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-e1f348ee-91e4-49eb-a3c8-9bd1baf230ff tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:12.598618 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e1f348ee-91e4-49eb-a3c8-9bd1baf230ff tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:12.599612 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e1f348ee-91e4-49eb-a3c8-9bd1baf230ff tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:12.600381 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e1f348ee-91e4-49eb-a3c8-9bd1baf230ff tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:12.600810 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e1f348ee-91e4-49eb-a3c8-9bd1baf230ff tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:12.615430 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-6007b15e-6c8a-4748-9536-739314f8004a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action" status: 200 len: 18356 microversion: 2.20 time: 0.128996 Sep 02 17:14:12.619020 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 507/954] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:14:12 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action => generated 18356 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:14:12.719170 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-e1f348ee-91e4-49eb-a3c8-9bd1baf230ff tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:12.726845 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-e1f348ee-91e4-49eb-a3c8-9bd1baf230ff tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1443 microversion: 2.1 time: 0.138801 Sep 02 17:14:12.727395 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 448/955] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:14:12 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1443 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:14:13.597968 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-3e151d80-727e-4eee-bc11-baf20d30de45 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:13.599179 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-3e151d80-727e-4eee-bc11-baf20d30de45 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:13.605875 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3e151d80-727e-4eee-bc11-baf20d30de45 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:13.606323 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3e151d80-727e-4eee-bc11-baf20d30de45 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:13.607137 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3e151d80-727e-4eee-bc11-baf20d30de45 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:13.607566 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3e151d80-727e-4eee-bc11-baf20d30de45 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:13.626096 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-7522c48a-ecae-4863-8303-5116efdcf42e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:13.627021 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-7522c48a-ecae-4863-8303-5116efdcf42e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:13.633921 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7522c48a-ecae-4863-8303-5116efdcf42e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:13.634363 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7522c48a-ecae-4863-8303-5116efdcf42e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:13.635291 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7522c48a-ecae-4863-8303-5116efdcf42e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:13.635717 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7522c48a-ecae-4863-8303-5116efdcf42e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:13.731651 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-3e151d80-727e-4eee-bc11-baf20d30de45 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.137307 Sep 02 17:14:13.732981 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 508/956] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:13 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:13.764858 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-7522c48a-ecae-4863-8303-5116efdcf42e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action" status: 200 len: 19539 microversion: 2.20 time: 0.142211 Sep 02 17:14:13.768551 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 449/957] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:14:13 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action => generated 19539 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:14:14.455963 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-84845f7a-0fc4-4765-8eac-810f66bfae49 req-942e141f-1445-4f81-8b3b-8cd944e5eb39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cea6ec2a-41c7-41c5-8471-3da2ba130315", "tag": "f0347608-2078-4ebd-b282-53b22f166ac6"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:14.457489 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:14:14.457489 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:14:14.465309 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-84845f7a-0fc4-4765-8eac-810f66bfae49 req-942e141f-1445-4f81-8b3b-8cd944e5eb39 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:14.465752 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-84845f7a-0fc4-4765-8eac-810f66bfae49 req-942e141f-1445-4f81-8b3b-8cd944e5eb39 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:14.476803 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-84845f7a-0fc4-4765-8eac-810f66bfae49 req-942e141f-1445-4f81-8b3b-8cd944e5eb39 service nova] Creating event network-changed:f0347608-2078-4ebd-b282-53b22f166ac6 for instance cea6ec2a-41c7-41c5-8471-3da2ba130315 on hv-cinder-80626 Sep 02 17:14:14.481855 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-84845f7a-0fc4-4765-8eac-810f66bfae49 req-942e141f-1445-4f81-8b3b-8cd944e5eb39 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094488 Sep 02 17:14:14.482579 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 509/958] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:14:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:14:14.747301 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-1d81f03b-ac25-437c-9589-5dbb77088eb2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:14.748247 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-1d81f03b-ac25-437c-9589-5dbb77088eb2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:14.754807 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1d81f03b-ac25-437c-9589-5dbb77088eb2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:14.755270 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1d81f03b-ac25-437c-9589-5dbb77088eb2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:14.756248 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1d81f03b-ac25-437c-9589-5dbb77088eb2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:14.756660 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1d81f03b-ac25-437c-9589-5dbb77088eb2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:14.778057 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-9c3a41eb-0db0-4b57-9af8-88ab77563869 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:14.779620 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-9c3a41eb-0db0-4b57-9af8-88ab77563869 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:14.788816 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9c3a41eb-0db0-4b57-9af8-88ab77563869 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:14.789587 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9c3a41eb-0db0-4b57-9af8-88ab77563869 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:14.790410 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9c3a41eb-0db0-4b57-9af8-88ab77563869 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:14.790874 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9c3a41eb-0db0-4b57-9af8-88ab77563869 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:14.863417 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-1d81f03b-ac25-437c-9589-5dbb77088eb2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.120146 Sep 02 17:14:14.864570 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 450/959] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:14 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:14.902673 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-9c3a41eb-0db0-4b57-9af8-88ab77563869 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action" status: 200 len: 22546 microversion: 2.20 time: 0.129162 Sep 02 17:14:14.903613 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 510/960] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:14:14 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action => generated 22546 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:14:15.876980 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-e606b78c-e23b-4f2c-8f77-1bc7f4e43c88 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:15.877886 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-e606b78c-e23b-4f2c-8f77-1bc7f4e43c88 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:15.885207 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e606b78c-e23b-4f2c-8f77-1bc7f4e43c88 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:15.885655 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e606b78c-e23b-4f2c-8f77-1bc7f4e43c88 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:15.886454 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e606b78c-e23b-4f2c-8f77-1bc7f4e43c88 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:15.886922 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e606b78c-e23b-4f2c-8f77-1bc7f4e43c88 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:15.915787 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-88e945fa-058b-474c-be36-c8a7f3885f77 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:15.916777 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-88e945fa-058b-474c-be36-c8a7f3885f77 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:15.923185 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-88e945fa-058b-474c-be36-c8a7f3885f77 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:15.923635 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-88e945fa-058b-474c-be36-c8a7f3885f77 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:15.924398 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-88e945fa-058b-474c-be36-c8a7f3885f77 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:15.924829 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-88e945fa-058b-474c-be36-c8a7f3885f77 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:15.991419 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-e606b78c-e23b-4f2c-8f77-1bc7f4e43c88 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.118370 Sep 02 17:14:15.992064 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 451/961] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:15 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:16.023319 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-88e945fa-058b-474c-be36-c8a7f3885f77 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action" status: 200 len: 23804 microversion: 2.20 time: 0.111830 Sep 02 17:14:16.023928 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 511/962] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:14:15 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action => generated 23804 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:14:17.002815 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-7aca9d09-facc-40cf-9491-525d2268d5ff tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:17.003794 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-7aca9d09-facc-40cf-9491-525d2268d5ff tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:17.010970 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7aca9d09-facc-40cf-9491-525d2268d5ff tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:17.011417 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7aca9d09-facc-40cf-9491-525d2268d5ff tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:17.012180 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7aca9d09-facc-40cf-9491-525d2268d5ff tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:17.012616 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7aca9d09-facc-40cf-9491-525d2268d5ff tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:17.034985 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-23725c3a-dbd2-4ce5-9341-27ad6cc048d8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:17.035968 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-23725c3a-dbd2-4ce5-9341-27ad6cc048d8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:17.042645 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-23725c3a-dbd2-4ce5-9341-27ad6cc048d8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:17.043101 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-23725c3a-dbd2-4ce5-9341-27ad6cc048d8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:17.043855 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-23725c3a-dbd2-4ce5-9341-27ad6cc048d8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:17.044282 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-23725c3a-dbd2-4ce5-9341-27ad6cc048d8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:17.111855 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-7aca9d09-facc-40cf-9491-525d2268d5ff tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.112892 Sep 02 17:14:17.115209 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 452/963] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:16 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:17.142121 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-23725c3a-dbd2-4ce5-9341-27ad6cc048d8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action" status: 200 len: 25208 microversion: 2.20 time: 0.110981 Sep 02 17:14:17.142772 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 512/964] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:14:17 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action => generated 25208 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:14:18.124561 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-0c6f0cd5-bbaf-44d9-b99f-dd7806343fd6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:18.125536 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-0c6f0cd5-bbaf-44d9-b99f-dd7806343fd6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:18.132618 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0c6f0cd5-bbaf-44d9-b99f-dd7806343fd6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:18.133051 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0c6f0cd5-bbaf-44d9-b99f-dd7806343fd6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:18.133797 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0c6f0cd5-bbaf-44d9-b99f-dd7806343fd6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:18.134220 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0c6f0cd5-bbaf-44d9-b99f-dd7806343fd6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:18.153839 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-3b6df58c-c304-475e-b70e-8884431bdff0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:18.154860 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-3b6df58c-c304-475e-b70e-8884431bdff0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:18.161310 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3b6df58c-c304-475e-b70e-8884431bdff0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:18.162332 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3b6df58c-c304-475e-b70e-8884431bdff0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:18.162706 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3b6df58c-c304-475e-b70e-8884431bdff0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:18.163144 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3b6df58c-c304-475e-b70e-8884431bdff0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:18.238706 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-0c6f0cd5-bbaf-44d9-b99f-dd7806343fd6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.117969 Sep 02 17:14:18.239664 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 453/965] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:18 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:18.263680 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-3b6df58c-c304-475e-b70e-8884431bdff0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action" status: 200 len: 26632 microversion: 2.20 time: 0.113731 Sep 02 17:14:18.264317 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 513/966] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:14:18 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action => generated 26632 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:14:19.251287 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-15978332-cb0e-454b-b50e-9d4054520ba5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:19.252281 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-15978332-cb0e-454b-b50e-9d4054520ba5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:19.259502 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-15978332-cb0e-454b-b50e-9d4054520ba5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:19.259981 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-15978332-cb0e-454b-b50e-9d4054520ba5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:19.260748 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-15978332-cb0e-454b-b50e-9d4054520ba5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:19.261183 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-15978332-cb0e-454b-b50e-9d4054520ba5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:19.276038 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-2fce13e4-4496-444a-adc1-fc9e3c6f9731 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:19.277057 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-2fce13e4-4496-444a-adc1-fc9e3c6f9731 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:19.283667 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2fce13e4-4496-444a-adc1-fc9e3c6f9731 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:19.284121 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2fce13e4-4496-444a-adc1-fc9e3c6f9731 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:19.285051 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2fce13e4-4496-444a-adc1-fc9e3c6f9731 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:19.285490 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2fce13e4-4496-444a-adc1-fc9e3c6f9731 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:19.370406 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-15978332-cb0e-454b-b50e-9d4054520ba5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.122962 Sep 02 17:14:19.371090 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 454/967] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:19 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:19.391396 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-2fce13e4-4496-444a-adc1-fc9e3c6f9731 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action" status: 200 len: 27443 microversion: 2.20 time: 0.119760 Sep 02 17:14:19.392060 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 514/968] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:14:19 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action => generated 27443 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:14:20.382906 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-765db8cc-31c1-4521-b65a-e8bdd4e98063 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:20.383901 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-765db8cc-31c1-4521-b65a-e8bdd4e98063 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:20.391094 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-765db8cc-31c1-4521-b65a-e8bdd4e98063 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:20.391535 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-765db8cc-31c1-4521-b65a-e8bdd4e98063 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:20.392298 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-765db8cc-31c1-4521-b65a-e8bdd4e98063 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:20.392721 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-765db8cc-31c1-4521-b65a-e8bdd4e98063 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:20.403004 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-3a49a74f-db16-49e2-82ea-dd9d7e73d329 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:20.404034 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-3a49a74f-db16-49e2-82ea-dd9d7e73d329 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:20.410437 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3a49a74f-db16-49e2-82ea-dd9d7e73d329 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:20.410917 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3a49a74f-db16-49e2-82ea-dd9d7e73d329 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:20.412376 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3a49a74f-db16-49e2-82ea-dd9d7e73d329 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:20.412814 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3a49a74f-db16-49e2-82ea-dd9d7e73d329 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:20.499051 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-765db8cc-31c1-4521-b65a-e8bdd4e98063 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.119929 Sep 02 17:14:20.499943 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 455/969] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:20 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:20.521784 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-3a49a74f-db16-49e2-82ea-dd9d7e73d329 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action" status: 200 len: 27923 microversion: 2.20 time: 0.122141 Sep 02 17:14:20.522406 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 515/970] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:14:20 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action => generated 27923 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:14:21.511634 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-530aaa30-af0c-4ed6-a877-929f8cac8d48 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:21.512636 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-530aaa30-af0c-4ed6-a877-929f8cac8d48 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:21.519206 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-530aaa30-af0c-4ed6-a877-929f8cac8d48 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:21.519659 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-530aaa30-af0c-4ed6-a877-929f8cac8d48 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:21.520430 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-530aaa30-af0c-4ed6-a877-929f8cac8d48 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:21.520865 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-530aaa30-af0c-4ed6-a877-929f8cac8d48 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:21.533090 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-10c5493b-a7db-4908-b057-1f71f9fe717f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:21.534081 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-10c5493b-a7db-4908-b057-1f71f9fe717f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:21.543336 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-10c5493b-a7db-4908-b057-1f71f9fe717f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:21.544049 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-10c5493b-a7db-4908-b057-1f71f9fe717f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:21.545301 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-10c5493b-a7db-4908-b057-1f71f9fe717f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:21.546011 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-10c5493b-a7db-4908-b057-1f71f9fe717f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:21.634328 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-530aaa30-af0c-4ed6-a877-929f8cac8d48 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.126630 Sep 02 17:14:21.635065 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 456/971] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:21 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:21.673485 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-10c5493b-a7db-4908-b057-1f71f9fe717f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action" status: 200 len: 28161 microversion: 2.20 time: 0.144347 Sep 02 17:14:21.674087 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 516/972] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:14:21 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action => generated 28161 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:14:22.645704 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-7dfec760-62e4-4981-a403-f91600938430 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:22.647214 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-7dfec760-62e4-4981-a403-f91600938430 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:22.653712 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7dfec760-62e4-4981-a403-f91600938430 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:22.654150 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7dfec760-62e4-4981-a403-f91600938430 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:22.654932 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7dfec760-62e4-4981-a403-f91600938430 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:22.655360 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7dfec760-62e4-4981-a403-f91600938430 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:22.686489 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-59595ece-002a-47ef-9de1-a07a5f618036 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:22.687492 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-59595ece-002a-47ef-9de1-a07a5f618036 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:22.693545 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-59595ece-002a-47ef-9de1-a07a5f618036 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:22.693988 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-59595ece-002a-47ef-9de1-a07a5f618036 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:22.694782 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-59595ece-002a-47ef-9de1-a07a5f618036 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:22.695214 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-59595ece-002a-47ef-9de1-a07a5f618036 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:22.769005 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-7dfec760-62e4-4981-a403-f91600938430 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.127017 Sep 02 17:14:22.769697 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 457/973] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:22 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:22.801940 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-59595ece-002a-47ef-9de1-a07a5f618036 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action" status: 200 len: 28286 microversion: 2.20 time: 0.119797 Sep 02 17:14:22.802572 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 517/974] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:14:22 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action => generated 28286 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:14:23.781551 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-67fcd400-195c-48d7-baea-7dcd362f9e57 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:23.782535 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-67fcd400-195c-48d7-baea-7dcd362f9e57 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:23.789154 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-67fcd400-195c-48d7-baea-7dcd362f9e57 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:23.789600 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-67fcd400-195c-48d7-baea-7dcd362f9e57 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:23.790364 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-67fcd400-195c-48d7-baea-7dcd362f9e57 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:23.790863 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-67fcd400-195c-48d7-baea-7dcd362f9e57 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:23.813051 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-49b83fe3-b17c-41c3-99cb-980f15ba5a0f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:23.814041 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-49b83fe3-b17c-41c3-99cb-980f15ba5a0f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:23.820895 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-49b83fe3-b17c-41c3-99cb-980f15ba5a0f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:23.821341 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-49b83fe3-b17c-41c3-99cb-980f15ba5a0f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:23.822107 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-49b83fe3-b17c-41c3-99cb-980f15ba5a0f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:23.822541 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-49b83fe3-b17c-41c3-99cb-980f15ba5a0f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:23.911521 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-67fcd400-195c-48d7-baea-7dcd362f9e57 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.133820 Sep 02 17:14:23.912257 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 458/975] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:23 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:23.953002 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-49b83fe3-b17c-41c3-99cb-980f15ba5a0f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action" status: 200 len: 28452 microversion: 2.20 time: 0.143701 Sep 02 17:14:23.953643 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 518/976] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:14:23 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action => generated 28452 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:14:24.924754 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-72924039-2dab-4c3c-a7ae-6c08e845b94d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:24.925770 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-72924039-2dab-4c3c-a7ae-6c08e845b94d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:24.932896 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-72924039-2dab-4c3c-a7ae-6c08e845b94d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:24.933414 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-72924039-2dab-4c3c-a7ae-6c08e845b94d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:24.934415 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-72924039-2dab-4c3c-a7ae-6c08e845b94d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:24.934951 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-72924039-2dab-4c3c-a7ae-6c08e845b94d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:24.965145 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-ed9a1e6d-db38-4269-b2d5-b99fbc217120 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:24.966196 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-ed9a1e6d-db38-4269-b2d5-b99fbc217120 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:24.972752 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ed9a1e6d-db38-4269-b2d5-b99fbc217120 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:24.973205 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ed9a1e6d-db38-4269-b2d5-b99fbc217120 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:24.973971 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ed9a1e6d-db38-4269-b2d5-b99fbc217120 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:24.974407 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ed9a1e6d-db38-4269-b2d5-b99fbc217120 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:25.038160 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-72924039-2dab-4c3c-a7ae-6c08e845b94d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.117488 Sep 02 17:14:25.038830 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 459/977] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:24 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:25.070812 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-ed9a1e6d-db38-4269-b2d5-b99fbc217120 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action" status: 200 len: 28620 microversion: 2.20 time: 0.109667 Sep 02 17:14:25.071429 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 519/978] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:14:24 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action => generated 28620 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:14:26.049717 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-a81bbdf5-2c43-4f21-92e4-a970e10c8436 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:26.050725 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-a81bbdf5-2c43-4f21-92e4-a970e10c8436 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:26.057062 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a81bbdf5-2c43-4f21-92e4-a970e10c8436 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:26.057502 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a81bbdf5-2c43-4f21-92e4-a970e10c8436 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:26.058248 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a81bbdf5-2c43-4f21-92e4-a970e10c8436 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:26.058693 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a81bbdf5-2c43-4f21-92e4-a970e10c8436 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:26.082803 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-f2abaf14-c38e-451f-ac10-f6bf2933dd3c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:26.084414 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-f2abaf14-c38e-451f-ac10-f6bf2933dd3c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:26.094695 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f2abaf14-c38e-451f-ac10-f6bf2933dd3c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:26.095487 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f2abaf14-c38e-451f-ac10-f6bf2933dd3c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:26.096843 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f2abaf14-c38e-451f-ac10-f6bf2933dd3c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:26.097522 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f2abaf14-c38e-451f-ac10-f6bf2933dd3c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:26.170539 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-a81bbdf5-2c43-4f21-92e4-a970e10c8436 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.124645 Sep 02 17:14:26.171249 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 460/979] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:26 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:26.196504 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-f2abaf14-c38e-451f-ac10-f6bf2933dd3c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action" status: 200 len: 28620 microversion: 2.20 time: 0.117725 Sep 02 17:14:26.197153 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 520/980] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:14:26 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action => generated 28620 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:14:27.182989 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-234e432b-e0a4-4c00-9f45-9a76337587f8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:27.183964 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-234e432b-e0a4-4c00-9f45-9a76337587f8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:27.190324 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-234e432b-e0a4-4c00-9f45-9a76337587f8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:27.190789 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-234e432b-e0a4-4c00-9f45-9a76337587f8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:27.191537 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-234e432b-e0a4-4c00-9f45-9a76337587f8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:27.191960 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-234e432b-e0a4-4c00-9f45-9a76337587f8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:27.208044 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-bbce3fb9-2061-4979-96a9-0100d2378ddf tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:27.209042 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-bbce3fb9-2061-4979-96a9-0100d2378ddf tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:27.216212 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bbce3fb9-2061-4979-96a9-0100d2378ddf tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:27.216594 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bbce3fb9-2061-4979-96a9-0100d2378ddf tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:27.218081 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bbce3fb9-2061-4979-96a9-0100d2378ddf tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:27.218518 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bbce3fb9-2061-4979-96a9-0100d2378ddf tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:27.300344 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-234e432b-e0a4-4c00-9f45-9a76337587f8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.121209 Sep 02 17:14:27.301020 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 461/981] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:27 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:27.314490 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-bbce3fb9-2061-4979-96a9-0100d2378ddf tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action" status: 200 len: 28620 microversion: 2.20 time: 0.110295 Sep 02 17:14:27.315143 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 521/982] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:14:27 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action => generated 28620 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:14:28.312592 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-a21257b4-5180-4a2b-9163-4d003b2b3954 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:28.313569 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-a21257b4-5180-4a2b-9163-4d003b2b3954 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:28.319959 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a21257b4-5180-4a2b-9163-4d003b2b3954 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:28.320400 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a21257b4-5180-4a2b-9163-4d003b2b3954 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:28.321152 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a21257b4-5180-4a2b-9163-4d003b2b3954 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:28.321579 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a21257b4-5180-4a2b-9163-4d003b2b3954 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:28.325790 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-4982e398-56d2-4bf4-9417-4aa5b6e9433b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:28.326824 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-4982e398-56d2-4bf4-9417-4aa5b6e9433b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:28.333279 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4982e398-56d2-4bf4-9417-4aa5b6e9433b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:28.333721 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4982e398-56d2-4bf4-9417-4aa5b6e9433b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:28.334488 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4982e398-56d2-4bf4-9417-4aa5b6e9433b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:28.334943 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4982e398-56d2-4bf4-9417-4aa5b6e9433b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:28.419016 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-a21257b4-5180-4a2b-9163-4d003b2b3954 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.110200 Sep 02 17:14:28.420026 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 462/983] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:28 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:28.460787 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-4982e398-56d2-4bf4-9417-4aa5b6e9433b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action" status: 200 len: 29421 microversion: 2.20 time: 0.138846 Sep 02 17:14:28.461461 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 522/984] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:14:28 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action => generated 29421 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:14:29.432366 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-e11d6726-e636-4cd7-bb76-ad5a0afd0b28 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:29.433350 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-e11d6726-e636-4cd7-bb76-ad5a0afd0b28 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:29.440483 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e11d6726-e636-4cd7-bb76-ad5a0afd0b28 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:29.440920 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e11d6726-e636-4cd7-bb76-ad5a0afd0b28 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:29.441670 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e11d6726-e636-4cd7-bb76-ad5a0afd0b28 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:29.442094 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e11d6726-e636-4cd7-bb76-ad5a0afd0b28 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:29.475139 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-e72cf315-f92b-437c-a01c-75fdad0aa12b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:29.476137 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-e72cf315-f92b-437c-a01c-75fdad0aa12b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:29.482612 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e72cf315-f92b-437c-a01c-75fdad0aa12b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:29.483097 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e72cf315-f92b-437c-a01c-75fdad0aa12b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:29.483865 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e72cf315-f92b-437c-a01c-75fdad0aa12b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:29.484301 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e72cf315-f92b-437c-a01c-75fdad0aa12b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:29.552815 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-e11d6726-e636-4cd7-bb76-ad5a0afd0b28 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.124852 Sep 02 17:14:29.554048 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 463/985] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:29 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:29.590496 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-e72cf315-f92b-437c-a01c-75fdad0aa12b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action" status: 200 len: 31105 microversion: 2.20 time: 0.119539 Sep 02 17:14:29.591006 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 523/986] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:14:29 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action => generated 31105 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:14:30.565439 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-da25eec0-a659-4fdf-a829-6438d3665ff6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:30.566413 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-da25eec0-a659-4fdf-a829-6438d3665ff6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:30.573476 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-da25eec0-a659-4fdf-a829-6438d3665ff6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:30.573914 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-da25eec0-a659-4fdf-a829-6438d3665ff6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:30.574688 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-da25eec0-a659-4fdf-a829-6438d3665ff6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:30.575123 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-da25eec0-a659-4fdf-a829-6438d3665ff6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:30.601850 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-072c0086-9a73-450d-a3d6-f7537b58e299 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:30.602901 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-072c0086-9a73-450d-a3d6-f7537b58e299 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:30.609314 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-072c0086-9a73-450d-a3d6-f7537b58e299 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:30.609760 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-072c0086-9a73-450d-a3d6-f7537b58e299 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:30.610525 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-072c0086-9a73-450d-a3d6-f7537b58e299 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:30.610989 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-072c0086-9a73-450d-a3d6-f7537b58e299 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:30.675605 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-da25eec0-a659-4fdf-a829-6438d3665ff6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.114007 Sep 02 17:14:30.676242 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 464/987] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:30 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:30.706181 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-072c0086-9a73-450d-a3d6-f7537b58e299 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action" status: 200 len: 32618 microversion: 2.20 time: 0.108207 Sep 02 17:14:30.706824 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 524/988] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:14:30 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action => generated 32618 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:14:31.688203 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-d4051522-211f-4a8e-86e5-cb1f2527d81a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:31.689184 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-d4051522-211f-4a8e-86e5-cb1f2527d81a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:31.695533 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d4051522-211f-4a8e-86e5-cb1f2527d81a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:31.695974 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d4051522-211f-4a8e-86e5-cb1f2527d81a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:31.696729 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d4051522-211f-4a8e-86e5-cb1f2527d81a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:31.697158 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d4051522-211f-4a8e-86e5-cb1f2527d81a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:31.718832 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-3ddc926d-9138-45fb-88de-3bb7d582e19f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:31.719811 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-3ddc926d-9138-45fb-88de-3bb7d582e19f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:31.727506 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3ddc926d-9138-45fb-88de-3bb7d582e19f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:31.727948 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3ddc926d-9138-45fb-88de-3bb7d582e19f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:31.728703 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3ddc926d-9138-45fb-88de-3bb7d582e19f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:31.729130 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3ddc926d-9138-45fb-88de-3bb7d582e19f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:31.808578 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-d4051522-211f-4a8e-86e5-cb1f2527d81a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.124218 Sep 02 17:14:31.809233 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 465/989] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:31 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:14:31.827828 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-3ddc926d-9138-45fb-88de-3bb7d582e19f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action" status: 200 len: 33351 microversion: 2.20 time: 0.112908 Sep 02 17:14:31.828463 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 525/990] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:14:31 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action => generated 33351 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:14:32.821217 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-55b89981-81b2-4714-892c-2447a2f726fb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:32.822195 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-55b89981-81b2-4714-892c-2447a2f726fb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:32.828598 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-55b89981-81b2-4714-892c-2447a2f726fb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:32.829035 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-55b89981-81b2-4714-892c-2447a2f726fb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:32.829790 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-55b89981-81b2-4714-892c-2447a2f726fb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:32.830216 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-55b89981-81b2-4714-892c-2447a2f726fb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:32.839890 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-285a6e89-0fd7-4cb8-988c-735932590fb5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:32.840878 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-285a6e89-0fd7-4cb8-988c-735932590fb5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:32.847109 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-285a6e89-0fd7-4cb8-988c-735932590fb5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:32.847587 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-285a6e89-0fd7-4cb8-988c-735932590fb5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:32.848314 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-285a6e89-0fd7-4cb8-988c-735932590fb5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:32.848745 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-285a6e89-0fd7-4cb8-988c-735932590fb5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:32.932883 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-55b89981-81b2-4714-892c-2447a2f726fb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.115566 Sep 02 17:14:32.933564 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 466/991] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:32 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:32.963660 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-285a6e89-0fd7-4cb8-988c-735932590fb5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action" status: 200 len: 34396 microversion: 2.20 time: 0.127569 Sep 02 17:14:32.964500 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 526/992] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:14:32 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action => generated 34396 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:14:33.945235 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-49e2fdf4-7125-467d-8e3e-ba27fe70fe09 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:33.946237 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-49e2fdf4-7125-467d-8e3e-ba27fe70fe09 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:33.952628 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-49e2fdf4-7125-467d-8e3e-ba27fe70fe09 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:33.953068 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-49e2fdf4-7125-467d-8e3e-ba27fe70fe09 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:33.953822 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-49e2fdf4-7125-467d-8e3e-ba27fe70fe09 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:33.954259 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-49e2fdf4-7125-467d-8e3e-ba27fe70fe09 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:33.976229 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-e13199d4-530d-4596-b5ac-b5be334be39d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:33.977314 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-e13199d4-530d-4596-b5ac-b5be334be39d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:33.984094 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e13199d4-530d-4596-b5ac-b5be334be39d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:33.984544 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e13199d4-530d-4596-b5ac-b5be334be39d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:33.985314 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e13199d4-530d-4596-b5ac-b5be334be39d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:33.985752 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e13199d4-530d-4596-b5ac-b5be334be39d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:34.063501 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-49e2fdf4-7125-467d-8e3e-ba27fe70fe09 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.122113 Sep 02 17:14:34.064415 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 467/993] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:33 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:34.084378 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-e13199d4-530d-4596-b5ac-b5be334be39d tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action" status: 200 len: 35626 microversion: 2.20 time: 0.112772 Sep 02 17:14:34.085501 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 527/994] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:14:33 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action => generated 35626 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:14:35.075608 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-3d32ea91-b6f3-48c5-a087-f1622ef8fb34 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:35.076599 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-3d32ea91-b6f3-48c5-a087-f1622ef8fb34 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:35.083125 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3d32ea91-b6f3-48c5-a087-f1622ef8fb34 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:35.083580 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3d32ea91-b6f3-48c5-a087-f1622ef8fb34 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:35.084344 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3d32ea91-b6f3-48c5-a087-f1622ef8fb34 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:35.084777 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3d32ea91-b6f3-48c5-a087-f1622ef8fb34 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:35.097166 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-8e1def50-6aff-40f7-8553-7b90697ba7a6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:35.098171 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-8e1def50-6aff-40f7-8553-7b90697ba7a6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:35.105144 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8e1def50-6aff-40f7-8553-7b90697ba7a6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:35.105821 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8e1def50-6aff-40f7-8553-7b90697ba7a6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:35.106903 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8e1def50-6aff-40f7-8553-7b90697ba7a6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:35.107346 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8e1def50-6aff-40f7-8553-7b90697ba7a6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:35.192186 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-3d32ea91-b6f3-48c5-a087-f1622ef8fb34 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.120403 Sep 02 17:14:35.193132 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 468/995] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:35 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:35.214965 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-8e1def50-6aff-40f7-8553-7b90697ba7a6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action" status: 200 len: 36972 microversion: 2.20 time: 0.121585 Sep 02 17:14:35.215528 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 528/996] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:14:35 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action => generated 36972 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:14:36.205090 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-9a8b6c00-9d50-4dfc-832e-54bf5bfbf50f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:36.206064 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-9a8b6c00-9d50-4dfc-832e-54bf5bfbf50f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:36.212940 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9a8b6c00-9d50-4dfc-832e-54bf5bfbf50f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:36.213376 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9a8b6c00-9d50-4dfc-832e-54bf5bfbf50f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:36.214123 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9a8b6c00-9d50-4dfc-832e-54bf5bfbf50f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:36.214547 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9a8b6c00-9d50-4dfc-832e-54bf5bfbf50f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:36.227597 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-718e4d8a-8f59-4d3b-af5d-b1fbd81af681 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:36.229003 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-718e4d8a-8f59-4d3b-af5d-b1fbd81af681 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:36.234841 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-718e4d8a-8f59-4d3b-af5d-b1fbd81af681 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:36.235288 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-718e4d8a-8f59-4d3b-af5d-b1fbd81af681 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:36.236532 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-718e4d8a-8f59-4d3b-af5d-b1fbd81af681 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:36.236532 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-718e4d8a-8f59-4d3b-af5d-b1fbd81af681 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:36.329878 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-9a8b6c00-9d50-4dfc-832e-54bf5bfbf50f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.128644 Sep 02 17:14:36.330511 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 469/997] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:36 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:36.350332 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-718e4d8a-8f59-4d3b-af5d-b1fbd81af681 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action" status: 200 len: 38149 microversion: 2.20 time: 0.127316 Sep 02 17:14:36.350986 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 529/998] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:14:36 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action => generated 38149 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:14:37.342365 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-f18b65c4-9b22-4b9d-9822-03172b7c17a9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:37.343385 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-f18b65c4-9b22-4b9d-9822-03172b7c17a9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:37.349826 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f18b65c4-9b22-4b9d-9822-03172b7c17a9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:37.350274 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f18b65c4-9b22-4b9d-9822-03172b7c17a9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:37.351103 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f18b65c4-9b22-4b9d-9822-03172b7c17a9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:37.352100 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f18b65c4-9b22-4b9d-9822-03172b7c17a9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:37.363157 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-cc56ef21-c4cc-40ef-b4ec-0acfe58a10b0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:37.364187 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-cc56ef21-c4cc-40ef-b4ec-0acfe58a10b0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:37.371697 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cc56ef21-c4cc-40ef-b4ec-0acfe58a10b0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:37.372149 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cc56ef21-c4cc-40ef-b4ec-0acfe58a10b0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:37.372921 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cc56ef21-c4cc-40ef-b4ec-0acfe58a10b0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:37.373356 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cc56ef21-c4cc-40ef-b4ec-0acfe58a10b0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:37.448736 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-f18b65c4-9b22-4b9d-9822-03172b7c17a9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.110263 Sep 02 17:14:37.449721 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 470/999] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:37 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:37.481730 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-cc56ef21-c4cc-40ef-b4ec-0acfe58a10b0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action" status: 200 len: 38170 microversion: 2.20 time: 0.122449 Sep 02 17:14:37.482348 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 530/1000] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:14:37 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action => generated 38170 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:14:38.461111 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-e0888b0c-bf04-4e98-960e-3249ffbd37b3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:38.462084 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-e0888b0c-bf04-4e98-960e-3249ffbd37b3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:38.468555 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e0888b0c-bf04-4e98-960e-3249ffbd37b3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:38.468988 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e0888b0c-bf04-4e98-960e-3249ffbd37b3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:38.469737 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e0888b0c-bf04-4e98-960e-3249ffbd37b3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:38.470161 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e0888b0c-bf04-4e98-960e-3249ffbd37b3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:38.494841 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-dbb7ab49-89e4-485a-a2a7-24995f5eba9a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:38.495754 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-dbb7ab49-89e4-485a-a2a7-24995f5eba9a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:38.502590 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-dbb7ab49-89e4-485a-a2a7-24995f5eba9a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:38.503074 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-dbb7ab49-89e4-485a-a2a7-24995f5eba9a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:38.503842 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-dbb7ab49-89e4-485a-a2a7-24995f5eba9a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:38.504276 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-dbb7ab49-89e4-485a-a2a7-24995f5eba9a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:38.586723 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-e0888b0c-bf04-4e98-960e-3249ffbd37b3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.129393 Sep 02 17:14:38.587371 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 471/1001] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:38 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:38.601075 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-dbb7ab49-89e4-485a-a2a7-24995f5eba9a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action" status: 200 len: 38170 microversion: 2.20 time: 0.110741 Sep 02 17:14:38.601777 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 531/1002] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:14:38 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action => generated 38170 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:14:39.599138 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-76154db3-eac0-429f-bd14-2197629af646 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:39.600149 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-76154db3-eac0-429f-bd14-2197629af646 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:39.607142 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-76154db3-eac0-429f-bd14-2197629af646 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:39.607582 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-76154db3-eac0-429f-bd14-2197629af646 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:39.608382 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-76154db3-eac0-429f-bd14-2197629af646 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:39.608768 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-76154db3-eac0-429f-bd14-2197629af646 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:39.614683 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-321f1a27-ac8b-4518-88f1-0fc235bb2b7e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:39.615680 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-321f1a27-ac8b-4518-88f1-0fc235bb2b7e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:39.622924 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-321f1a27-ac8b-4518-88f1-0fc235bb2b7e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:39.623375 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-321f1a27-ac8b-4518-88f1-0fc235bb2b7e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:39.624149 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-321f1a27-ac8b-4518-88f1-0fc235bb2b7e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:39.624585 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-321f1a27-ac8b-4518-88f1-0fc235bb2b7e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:39.708232 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-76154db3-eac0-429f-bd14-2197629af646 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.112978 Sep 02 17:14:39.708875 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 472/1003] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:39 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:39.740385 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-321f1a27-ac8b-4518-88f1-0fc235bb2b7e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action" status: 200 len: 38251 microversion: 2.20 time: 0.129858 Sep 02 17:14:39.741231 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 532/1004] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:14:39 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action => generated 38251 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:14:40.720528 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-f6b81c09-6ca3-4fce-9e47-578a92c9ca91 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:40.721554 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-f6b81c09-6ca3-4fce-9e47-578a92c9ca91 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:40.727939 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f6b81c09-6ca3-4fce-9e47-578a92c9ca91 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:40.728365 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f6b81c09-6ca3-4fce-9e47-578a92c9ca91 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:40.729114 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f6b81c09-6ca3-4fce-9e47-578a92c9ca91 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:40.729538 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f6b81c09-6ca3-4fce-9e47-578a92c9ca91 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:40.752320 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-87712cb0-f8c7-47fb-8ee9-f6fac115663c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:40.753346 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-87712cb0-f8c7-47fb-8ee9-f6fac115663c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:40.760750 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-87712cb0-f8c7-47fb-8ee9-f6fac115663c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:40.761200 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-87712cb0-f8c7-47fb-8ee9-f6fac115663c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:40.761973 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-87712cb0-f8c7-47fb-8ee9-f6fac115663c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:40.762409 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-87712cb0-f8c7-47fb-8ee9-f6fac115663c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:40.826320 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-f6b81c09-6ca3-4fce-9e47-578a92c9ca91 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.109597 Sep 02 17:14:40.826993 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 473/1005] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:40 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:40.859283 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-87712cb0-f8c7-47fb-8ee9-f6fac115663c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action" status: 200 len: 38309 microversion: 2.20 time: 0.110819 Sep 02 17:14:40.859952 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 533/1006] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:14:40 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action => generated 38309 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:14:40.871017 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-2dd69eab-bfd8-42e6-8b51-8c3b90d7b28a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:14:40.871584 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-2dd69eab-bfd8-42e6-8b51-8c3b90d7b28a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:40.878114 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2dd69eab-bfd8-42e6-8b51-8c3b90d7b28a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:40.878556 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2dd69eab-bfd8-42e6-8b51-8c3b90d7b28a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:40.879350 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2dd69eab-bfd8-42e6-8b51-8c3b90d7b28a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:40.879772 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2dd69eab-bfd8-42e6-8b51-8c3b90d7b28a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:40.902769 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-2dd69eab-bfd8-42e6-8b51-8c3b90d7b28a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/ips" status: 200 len: 153 microversion: 2.20 time: 0.036304 Sep 02 17:14:40.903319 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 474/1007] 10.222.0.41 () {60 vars in 1289 bytes} [Thu Sep 2 17:14:40 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/ips => generated 153 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:41.839469 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-f130a51a-b2e6-4ba4-8b03-74adb49bf5de tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:41.840481 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-f130a51a-b2e6-4ba4-8b03-74adb49bf5de tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:41.846916 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f130a51a-b2e6-4ba4-8b03-74adb49bf5de tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:41.847359 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f130a51a-b2e6-4ba4-8b03-74adb49bf5de tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:41.848111 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f130a51a-b2e6-4ba4-8b03-74adb49bf5de tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:41.848588 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f130a51a-b2e6-4ba4-8b03-74adb49bf5de tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:41.937742 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-f130a51a-b2e6-4ba4-8b03-74adb49bf5de tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.102803 Sep 02 17:14:41.938378 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 534/1008] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:41 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:42.949501 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-1a105f25-7447-4ed6-8b7b-724de9ce62be tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:42.950402 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-1a105f25-7447-4ed6-8b7b-724de9ce62be tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:42.956858 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1a105f25-7447-4ed6-8b7b-724de9ce62be tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:42.957300 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1a105f25-7447-4ed6-8b7b-724de9ce62be tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:42.958063 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1a105f25-7447-4ed6-8b7b-724de9ce62be tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:42.958501 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1a105f25-7447-4ed6-8b7b-724de9ce62be tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:43.022535 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-f7782beb-0c77-49f7-951b-509de2bb86b7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:43.023187 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-f7782beb-0c77-49f7-951b-509de2bb86b7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:43.030145 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f7782beb-0c77-49f7-951b-509de2bb86b7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:43.030595 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f7782beb-0c77-49f7-951b-509de2bb86b7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:43.031391 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f7782beb-0c77-49f7-951b-509de2bb86b7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:43.031816 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f7782beb-0c77-49f7-951b-509de2bb86b7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:43.051651 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-1a105f25-7447-4ed6-8b7b-724de9ce62be tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.105671 Sep 02 17:14:43.052557 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 475/1009] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:42 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:43.054514 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.objects.instance [None req-f7782beb-0c77-49f7-951b-509de2bb86b7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lazy-loading 'flavor' on Instance uuid 41c895d8-bf14-4b23-8657-02bf702bb50c {{(pid=108418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 17:14:43.332651 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-f7782beb-0c77-49f7-951b-509de2bb86b7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action" status: 202 len: 0 microversion: 2.20 time: 0.313983 Sep 02 17:14:43.333251 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 535/1010] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:14:43 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 02 17:14:43.343481 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-1556c059-566b-4ef6-bf1a-a163423ac9f4 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:14:43.344274 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-1556c059-566b-4ef6-bf1a-a163423ac9f4 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:43.351295 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1556c059-566b-4ef6-bf1a-a163423ac9f4 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:43.351809 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1556c059-566b-4ef6-bf1a-a163423ac9f4 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:43.352591 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1556c059-566b-4ef6-bf1a-a163423ac9f4 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:43.353016 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1556c059-566b-4ef6-bf1a-a163423ac9f4 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:43.477520 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-1556c059-566b-4ef6-bf1a-a163423ac9f4 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:43.485148 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-1556c059-566b-4ef6-bf1a-a163423ac9f4 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:43.486701 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-1556c059-566b-4ef6-bf1a-a163423ac9f4 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:43.487806 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-1556c059-566b-4ef6-bf1a-a163423ac9f4 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1724 microversion: 2.20 time: 0.149295 Sep 02 17:14:43.488359 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 476/1011] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:14:43 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:14:44.064594 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-96061390-9f55-46dc-9db7-20e8f86c3488 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:44.066350 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-96061390-9f55-46dc-9db7-20e8f86c3488 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:44.077162 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-96061390-9f55-46dc-9db7-20e8f86c3488 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:44.077959 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-96061390-9f55-46dc-9db7-20e8f86c3488 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:44.079075 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-96061390-9f55-46dc-9db7-20e8f86c3488 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:44.079677 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-96061390-9f55-46dc-9db7-20e8f86c3488 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:44.166468 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-96061390-9f55-46dc-9db7-20e8f86c3488 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.107391 Sep 02 17:14:44.167445 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 536/1012] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:44 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:14:44.506249 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-f9ce130a-58de-40d2-b062-5f8ac2eb6237 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:14:44.506779 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-f9ce130a-58de-40d2-b062-5f8ac2eb6237 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:44.512866 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f9ce130a-58de-40d2-b062-5f8ac2eb6237 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:44.513306 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f9ce130a-58de-40d2-b062-5f8ac2eb6237 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:44.514055 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f9ce130a-58de-40d2-b062-5f8ac2eb6237 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:44.514479 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f9ce130a-58de-40d2-b062-5f8ac2eb6237 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:44.631102 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-f9ce130a-58de-40d2-b062-5f8ac2eb6237 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:44.639198 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-f9ce130a-58de-40d2-b062-5f8ac2eb6237 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:44.640698 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-f9ce130a-58de-40d2-b062-5f8ac2eb6237 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:44.641830 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-f9ce130a-58de-40d2-b062-5f8ac2eb6237 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1724 microversion: 2.20 time: 0.139374 Sep 02 17:14:44.642374 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 477/1013] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:14:44 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1724 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:14:45.179297 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-7ab9965c-039c-4602-a3be-2f34f03a236b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:45.180807 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-7ab9965c-039c-4602-a3be-2f34f03a236b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:45.187343 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7ab9965c-039c-4602-a3be-2f34f03a236b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:45.187791 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7ab9965c-039c-4602-a3be-2f34f03a236b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:45.188591 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7ab9965c-039c-4602-a3be-2f34f03a236b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:45.189128 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7ab9965c-039c-4602-a3be-2f34f03a236b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:45.281552 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-7ab9965c-039c-4602-a3be-2f34f03a236b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.106277 Sep 02 17:14:45.282202 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 537/1014] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:45 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:45.660263 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-e139d077-0cf9-4abb-a95a-4bbcfb299a6f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:14:45.660865 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-e139d077-0cf9-4abb-a95a-4bbcfb299a6f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:45.667432 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e139d077-0cf9-4abb-a95a-4bbcfb299a6f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:45.667873 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e139d077-0cf9-4abb-a95a-4bbcfb299a6f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:45.668656 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e139d077-0cf9-4abb-a95a-4bbcfb299a6f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:45.669079 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e139d077-0cf9-4abb-a95a-4bbcfb299a6f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:45.785585 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-e139d077-0cf9-4abb-a95a-4bbcfb299a6f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:45.793717 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-e139d077-0cf9-4abb-a95a-4bbcfb299a6f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:45.795227 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-e139d077-0cf9-4abb-a95a-4bbcfb299a6f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:45.796362 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-e139d077-0cf9-4abb-a95a-4bbcfb299a6f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1724 microversion: 2.20 time: 0.139835 Sep 02 17:14:45.796902 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 478/1015] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:14:45 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1724 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:14:46.293874 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-b8d14f69-f890-447c-b997-f2b4840b16af tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:46.294941 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-b8d14f69-f890-447c-b997-f2b4840b16af tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:46.301411 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b8d14f69-f890-447c-b997-f2b4840b16af tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:46.301926 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b8d14f69-f890-447c-b997-f2b4840b16af tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:46.302815 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b8d14f69-f890-447c-b997-f2b4840b16af tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:46.303268 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b8d14f69-f890-447c-b997-f2b4840b16af tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:46.392702 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-b8d14f69-f890-447c-b997-f2b4840b16af tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.102745 Sep 02 17:14:46.393622 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 538/1016] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:46 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:46.813562 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-db5a98ee-16e1-405f-a7d8-7e90f99fd72e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:14:46.814152 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-db5a98ee-16e1-405f-a7d8-7e90f99fd72e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:46.820310 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-db5a98ee-16e1-405f-a7d8-7e90f99fd72e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:46.820749 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-db5a98ee-16e1-405f-a7d8-7e90f99fd72e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:46.821497 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-db5a98ee-16e1-405f-a7d8-7e90f99fd72e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:46.821919 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-db5a98ee-16e1-405f-a7d8-7e90f99fd72e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:46.943627 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-db5a98ee-16e1-405f-a7d8-7e90f99fd72e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:46.951701 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-db5a98ee-16e1-405f-a7d8-7e90f99fd72e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:46.953173 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-db5a98ee-16e1-405f-a7d8-7e90f99fd72e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:46.954309 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-db5a98ee-16e1-405f-a7d8-7e90f99fd72e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1724 microversion: 2.20 time: 0.144449 Sep 02 17:14:46.954883 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 479/1017] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:14:46 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1724 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:14:47.405219 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-79515174-5696-41f3-bb50-491cc12ecfaa tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:47.406134 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-79515174-5696-41f3-bb50-491cc12ecfaa tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:47.412567 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-79515174-5696-41f3-bb50-491cc12ecfaa tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:47.413005 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-79515174-5696-41f3-bb50-491cc12ecfaa tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:47.413778 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-79515174-5696-41f3-bb50-491cc12ecfaa tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:47.414201 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-79515174-5696-41f3-bb50-491cc12ecfaa tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:47.502757 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-79515174-5696-41f3-bb50-491cc12ecfaa tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.101502 Sep 02 17:14:47.503369 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 539/1018] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:47 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:47.972409 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-853c2efa-5774-4047-9293-d665f6c06588 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:14:47.973013 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-853c2efa-5774-4047-9293-d665f6c06588 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:47.978874 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-853c2efa-5774-4047-9293-d665f6c06588 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:47.979942 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-853c2efa-5774-4047-9293-d665f6c06588 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:47.980697 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-853c2efa-5774-4047-9293-d665f6c06588 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:47.981126 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-853c2efa-5774-4047-9293-d665f6c06588 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:48.098083 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-853c2efa-5774-4047-9293-d665f6c06588 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:48.106508 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-853c2efa-5774-4047-9293-d665f6c06588 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:48.108012 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-853c2efa-5774-4047-9293-d665f6c06588 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:48.109161 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-853c2efa-5774-4047-9293-d665f6c06588 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1724 microversion: 2.20 time: 0.140541 Sep 02 17:14:48.109708 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 480/1019] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:14:47 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1724 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:14:48.516055 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-f877c84f-afba-4187-9379-4e4e7aae8377 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:48.516996 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-f877c84f-afba-4187-9379-4e4e7aae8377 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:48.523472 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f877c84f-afba-4187-9379-4e4e7aae8377 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:48.523920 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f877c84f-afba-4187-9379-4e4e7aae8377 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:48.524681 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f877c84f-afba-4187-9379-4e4e7aae8377 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:48.525116 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f877c84f-afba-4187-9379-4e4e7aae8377 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:48.627160 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-f877c84f-afba-4187-9379-4e4e7aae8377 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.115035 Sep 02 17:14:48.628611 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 540/1020] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:48 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:14:49.134849 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-592e95f8-011f-44e0-8c1a-cb6bd4da4297 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:14:49.135963 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-592e95f8-011f-44e0-8c1a-cb6bd4da4297 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:49.142196 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-592e95f8-011f-44e0-8c1a-cb6bd4da4297 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:49.142695 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-592e95f8-011f-44e0-8c1a-cb6bd4da4297 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:49.143467 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-592e95f8-011f-44e0-8c1a-cb6bd4da4297 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:49.143898 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-592e95f8-011f-44e0-8c1a-cb6bd4da4297 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:49.264338 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-592e95f8-011f-44e0-8c1a-cb6bd4da4297 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:49.272079 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-592e95f8-011f-44e0-8c1a-cb6bd4da4297 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:49.273597 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-592e95f8-011f-44e0-8c1a-cb6bd4da4297 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:49.274769 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-592e95f8-011f-44e0-8c1a-cb6bd4da4297 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1724 microversion: 2.20 time: 0.143626 Sep 02 17:14:49.275321 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 481/1021] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:14:49 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1724 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:14:49.644533 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-1775a928-5210-40b2-b77b-8249cfbe6369 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:49.646351 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-1775a928-5210-40b2-b77b-8249cfbe6369 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:49.657208 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1775a928-5210-40b2-b77b-8249cfbe6369 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:49.658020 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1775a928-5210-40b2-b77b-8249cfbe6369 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:49.659242 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1775a928-5210-40b2-b77b-8249cfbe6369 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:49.660017 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1775a928-5210-40b2-b77b-8249cfbe6369 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:49.794470 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-1775a928-5210-40b2-b77b-8249cfbe6369 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.157388 Sep 02 17:14:49.795147 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 541/1022] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:49 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:50.293790 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-0c878152-fe89-40ec-b35c-5f158b34b104 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:14:50.294395 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-0c878152-fe89-40ec-b35c-5f158b34b104 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:50.300243 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0c878152-fe89-40ec-b35c-5f158b34b104 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:50.300681 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0c878152-fe89-40ec-b35c-5f158b34b104 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:50.301425 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0c878152-fe89-40ec-b35c-5f158b34b104 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:50.301848 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0c878152-fe89-40ec-b35c-5f158b34b104 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:50.422913 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-0c878152-fe89-40ec-b35c-5f158b34b104 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:50.430695 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-0c878152-fe89-40ec-b35c-5f158b34b104 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:50.432190 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-0c878152-fe89-40ec-b35c-5f158b34b104 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:50.433340 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-0c878152-fe89-40ec-b35c-5f158b34b104 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1724 microversion: 2.20 time: 0.143898 Sep 02 17:14:50.433893 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 482/1023] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:14:50 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1724 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:14:50.807376 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-ecd9f6c9-0702-4096-97ff-6a371f045281 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:50.808373 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-ecd9f6c9-0702-4096-97ff-6a371f045281 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:50.814777 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ecd9f6c9-0702-4096-97ff-6a371f045281 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:50.815223 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ecd9f6c9-0702-4096-97ff-6a371f045281 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:50.815982 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ecd9f6c9-0702-4096-97ff-6a371f045281 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:50.816414 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ecd9f6c9-0702-4096-97ff-6a371f045281 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:50.903831 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-ecd9f6c9-0702-4096-97ff-6a371f045281 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.100296 Sep 02 17:14:50.904378 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 542/1024] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:50 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:14:51.451099 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-a8ac6deb-a5a4-440e-b428-10b60808c2c4 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:14:51.451696 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-a8ac6deb-a5a4-440e-b428-10b60808c2c4 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:51.457863 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a8ac6deb-a5a4-440e-b428-10b60808c2c4 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:51.458307 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a8ac6deb-a5a4-440e-b428-10b60808c2c4 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:51.459158 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a8ac6deb-a5a4-440e-b428-10b60808c2c4 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:51.459585 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a8ac6deb-a5a4-440e-b428-10b60808c2c4 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:51.576621 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-a8ac6deb-a5a4-440e-b428-10b60808c2c4 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:51.584134 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-a8ac6deb-a5a4-440e-b428-10b60808c2c4 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:51.585599 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-a8ac6deb-a5a4-440e-b428-10b60808c2c4 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:51.586764 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-a8ac6deb-a5a4-440e-b428-10b60808c2c4 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1724 microversion: 2.20 time: 0.139337 Sep 02 17:14:51.587305 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 483/1025] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:14:51 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1724 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:14:51.917551 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-accec3b8-37a4-4b5c-b2ac-9249dfce2d0f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:51.918576 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-accec3b8-37a4-4b5c-b2ac-9249dfce2d0f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:51.924980 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-accec3b8-37a4-4b5c-b2ac-9249dfce2d0f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:51.925426 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-accec3b8-37a4-4b5c-b2ac-9249dfce2d0f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:51.926184 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-accec3b8-37a4-4b5c-b2ac-9249dfce2d0f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:51.926615 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-accec3b8-37a4-4b5c-b2ac-9249dfce2d0f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:52.017659 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-accec3b8-37a4-4b5c-b2ac-9249dfce2d0f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.104151 Sep 02 17:14:52.018319 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 543/1026] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:51 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:52.604360 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-bc44f1b0-944f-4940-a0f0-a85eac9afc9e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:14:52.605550 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-bc44f1b0-944f-4940-a0f0-a85eac9afc9e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:52.611347 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-bc44f1b0-944f-4940-a0f0-a85eac9afc9e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:52.611795 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-bc44f1b0-944f-4940-a0f0-a85eac9afc9e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:52.612556 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-bc44f1b0-944f-4940-a0f0-a85eac9afc9e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:52.612993 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-bc44f1b0-944f-4940-a0f0-a85eac9afc9e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:52.730742 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-bc44f1b0-944f-4940-a0f0-a85eac9afc9e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:52.738245 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-bc44f1b0-944f-4940-a0f0-a85eac9afc9e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:52.740023 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-bc44f1b0-944f-4940-a0f0-a85eac9afc9e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:52.741193 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-bc44f1b0-944f-4940-a0f0-a85eac9afc9e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1724 microversion: 2.20 time: 0.140549 Sep 02 17:14:52.741737 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 484/1027] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:14:52 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1724 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:14:53.029927 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-48ba10ba-5e07-445a-93e0-1ef0ef0e1860 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:53.030978 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-48ba10ba-5e07-445a-93e0-1ef0ef0e1860 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:53.037946 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-48ba10ba-5e07-445a-93e0-1ef0ef0e1860 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:53.038399 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-48ba10ba-5e07-445a-93e0-1ef0ef0e1860 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:53.039245 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-48ba10ba-5e07-445a-93e0-1ef0ef0e1860 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:53.039684 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-48ba10ba-5e07-445a-93e0-1ef0ef0e1860 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:53.145232 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-48ba10ba-5e07-445a-93e0-1ef0ef0e1860 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.119186 Sep 02 17:14:53.145873 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 544/1028] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:53 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:53.759401 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-baeea780-7d45-4496-8823-1ccf8bdfe841 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:14:53.759941 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-baeea780-7d45-4496-8823-1ccf8bdfe841 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:53.766575 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-baeea780-7d45-4496-8823-1ccf8bdfe841 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:53.767050 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-baeea780-7d45-4496-8823-1ccf8bdfe841 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:53.767810 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-baeea780-7d45-4496-8823-1ccf8bdfe841 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:53.768237 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-baeea780-7d45-4496-8823-1ccf8bdfe841 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:53.891013 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-baeea780-7d45-4496-8823-1ccf8bdfe841 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:53.898616 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-baeea780-7d45-4496-8823-1ccf8bdfe841 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:53.900126 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-baeea780-7d45-4496-8823-1ccf8bdfe841 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:53.901873 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-baeea780-7d45-4496-8823-1ccf8bdfe841 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1724 microversion: 2.20 time: 0.145717 Sep 02 17:14:53.902418 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 485/1029] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:14:53 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:14:54.157573 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-cd1f83cc-f545-439f-8d5c-3f2a1d847553 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:54.158565 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-cd1f83cc-f545-439f-8d5c-3f2a1d847553 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:54.165068 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cd1f83cc-f545-439f-8d5c-3f2a1d847553 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:54.165511 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cd1f83cc-f545-439f-8d5c-3f2a1d847553 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:54.166272 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cd1f83cc-f545-439f-8d5c-3f2a1d847553 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:54.166739 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cd1f83cc-f545-439f-8d5c-3f2a1d847553 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:54.258508 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-cd1f83cc-f545-439f-8d5c-3f2a1d847553 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.104820 Sep 02 17:14:54.259220 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 545/1030] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:54 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:14:54.921655 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-e349cc25-badb-49f2-a7b8-24030fc7cb1b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:14:54.922548 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-e349cc25-badb-49f2-a7b8-24030fc7cb1b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:54.928623 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e349cc25-badb-49f2-a7b8-24030fc7cb1b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:54.929079 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e349cc25-badb-49f2-a7b8-24030fc7cb1b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:54.929853 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e349cc25-badb-49f2-a7b8-24030fc7cb1b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:54.930289 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e349cc25-badb-49f2-a7b8-24030fc7cb1b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:55.050733 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-e349cc25-badb-49f2-a7b8-24030fc7cb1b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:55.058349 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-e349cc25-badb-49f2-a7b8-24030fc7cb1b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:55.059872 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-e349cc25-badb-49f2-a7b8-24030fc7cb1b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:55.061021 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-e349cc25-badb-49f2-a7b8-24030fc7cb1b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1745 microversion: 2.20 time: 0.144453 Sep 02 17:14:55.061568 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 486/1031] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:14:54 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1745 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:14:55.271549 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-732483de-9988-4213-a266-cf728be1e737 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:55.272547 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-732483de-9988-4213-a266-cf728be1e737 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:55.279609 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-732483de-9988-4213-a266-cf728be1e737 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:55.280050 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-732483de-9988-4213-a266-cf728be1e737 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:55.280808 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-732483de-9988-4213-a266-cf728be1e737 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:55.281256 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-732483de-9988-4213-a266-cf728be1e737 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:55.389800 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-732483de-9988-4213-a266-cf728be1e737 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.122071 Sep 02 17:14:55.390451 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 546/1032] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:55 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:56.078991 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-42e7ddbb-d975-4f83-adba-a798e1198f36 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:14:56.079562 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-42e7ddbb-d975-4f83-adba-a798e1198f36 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:56.085301 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-42e7ddbb-d975-4f83-adba-a798e1198f36 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:56.085738 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-42e7ddbb-d975-4f83-adba-a798e1198f36 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:56.086483 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-42e7ddbb-d975-4f83-adba-a798e1198f36 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:56.086930 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-42e7ddbb-d975-4f83-adba-a798e1198f36 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:56.220216 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-42e7ddbb-d975-4f83-adba-a798e1198f36 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:56.229549 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-42e7ddbb-d975-4f83-adba-a798e1198f36 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:56.232335 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-42e7ddbb-d975-4f83-adba-a798e1198f36 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:56.233654 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-42e7ddbb-d975-4f83-adba-a798e1198f36 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1745 microversion: 2.20 time: 0.158343 Sep 02 17:14:56.234413 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 487/1033] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:14:56 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:14:56.405259 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-aac085c8-aff5-4e5a-b6dd-15d8b68818fd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:56.406966 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-aac085c8-aff5-4e5a-b6dd-15d8b68818fd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:56.414272 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-aac085c8-aff5-4e5a-b6dd-15d8b68818fd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:56.414760 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-aac085c8-aff5-4e5a-b6dd-15d8b68818fd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:56.415565 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-aac085c8-aff5-4e5a-b6dd-15d8b68818fd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:56.416007 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-aac085c8-aff5-4e5a-b6dd-15d8b68818fd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:56.515646 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-aac085c8-aff5-4e5a-b6dd-15d8b68818fd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.116938 Sep 02 17:14:56.517310 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 547/1034] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:56 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:57.252425 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-6c6248b3-f8de-4385-863f-877230cbb100 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:14:57.253024 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-6c6248b3-f8de-4385-863f-877230cbb100 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:57.259389 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6c6248b3-f8de-4385-863f-877230cbb100 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:57.260145 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6c6248b3-f8de-4385-863f-877230cbb100 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:57.261702 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6c6248b3-f8de-4385-863f-877230cbb100 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:57.262204 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6c6248b3-f8de-4385-863f-877230cbb100 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:57.398299 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-6c6248b3-f8de-4385-863f-877230cbb100 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:57.406507 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-6c6248b3-f8de-4385-863f-877230cbb100 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:57.408111 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-6c6248b3-f8de-4385-863f-877230cbb100 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:57.409264 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-6c6248b3-f8de-4385-863f-877230cbb100 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1740 microversion: 2.20 time: 0.160522 Sep 02 17:14:57.409907 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 488/1035] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:14:57 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1740 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:14:57.530522 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-1cf28d66-54da-4d04-ad12-6ac910223c0d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:57.531592 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-1cf28d66-54da-4d04-ad12-6ac910223c0d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:57.540907 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1cf28d66-54da-4d04-ad12-6ac910223c0d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:57.541780 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1cf28d66-54da-4d04-ad12-6ac910223c0d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:57.543775 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1cf28d66-54da-4d04-ad12-6ac910223c0d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:57.544470 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1cf28d66-54da-4d04-ad12-6ac910223c0d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:57.647784 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-1cf28d66-54da-4d04-ad12-6ac910223c0d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.123223 Sep 02 17:14:57.648553 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 548/1036] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:57 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:58.015441 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [req-74665d62-b1ee-48dd-9467-e2c3605fa91d req-9ca4283e-a71b-4c4f-b620-8fbad4f7bc5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41c895d8-bf14-4b23-8657-02bf702bb50c", "name": "network-vif-plugged", "status": "completed", "tag": "88ce9e99-9c0c-4984-9fbe-83639825e7cc"}]} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:58.017769 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:14:58.017769 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: warnings.warn(msg) Sep 02 17:14:58.033673 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-74665d62-b1ee-48dd-9467-e2c3605fa91d req-9ca4283e-a71b-4c4f-b620-8fbad4f7bc5c service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:58.034119 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-74665d62-b1ee-48dd-9467-e2c3605fa91d req-9ca4283e-a71b-4c4f-b620-8fbad4f7bc5c service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:58.047111 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.compute.server_external_events [req-74665d62-b1ee-48dd-9467-e2c3605fa91d req-9ca4283e-a71b-4c4f-b620-8fbad4f7bc5c service nova] Creating event network-vif-plugged:88ce9e99-9c0c-4984-9fbe-83639825e7cc for instance 41c895d8-bf14-4b23-8657-02bf702bb50c on hv-cinder-80626 Sep 02 17:14:58.052366 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [req-74665d62-b1ee-48dd-9467-e2c3605fa91d req-9ca4283e-a71b-4c4f-b620-8fbad4f7bc5c service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115525 Sep 02 17:14:58.053078 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 489/1037] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:14:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:14:58.430581 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-dffbf592-7894-46bb-9235-8278fcbecfad tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:14:58.431463 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-dffbf592-7894-46bb-9235-8278fcbecfad tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:58.438701 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-dffbf592-7894-46bb-9235-8278fcbecfad tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:58.439240 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-dffbf592-7894-46bb-9235-8278fcbecfad tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:58.440101 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-dffbf592-7894-46bb-9235-8278fcbecfad tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:58.440632 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-dffbf592-7894-46bb-9235-8278fcbecfad tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:58.596871 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-dffbf592-7894-46bb-9235-8278fcbecfad tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:58.605574 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-dffbf592-7894-46bb-9235-8278fcbecfad tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:58.607441 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-dffbf592-7894-46bb-9235-8278fcbecfad tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:58.608722 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-dffbf592-7894-46bb-9235-8278fcbecfad tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1740 microversion: 2.20 time: 0.184490 Sep 02 17:14:58.609372 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 549/1038] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:14:58 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:14:58.660122 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-b298c8d7-86da-4267-9c33-bfcd02a62512 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:58.661396 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-b298c8d7-86da-4267-9c33-bfcd02a62512 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:58.673284 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b298c8d7-86da-4267-9c33-bfcd02a62512 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:58.673737 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b298c8d7-86da-4267-9c33-bfcd02a62512 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:58.674565 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b298c8d7-86da-4267-9c33-bfcd02a62512 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:58.675023 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b298c8d7-86da-4267-9c33-bfcd02a62512 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:58.782248 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-b298c8d7-86da-4267-9c33-bfcd02a62512 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.124442 Sep 02 17:14:58.785449 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 490/1039] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:58 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:14:59.628572 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-b110b06c-f735-4406-acfe-bb518d9dd49a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:14:59.629230 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-b110b06c-f735-4406-acfe-bb518d9dd49a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:59.637106 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b110b06c-f735-4406-acfe-bb518d9dd49a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:59.637106 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b110b06c-f735-4406-acfe-bb518d9dd49a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:59.638932 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b110b06c-f735-4406-acfe-bb518d9dd49a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:59.639813 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b110b06c-f735-4406-acfe-bb518d9dd49a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:59.781993 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-b110b06c-f735-4406-acfe-bb518d9dd49a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:59.790413 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-b110b06c-f735-4406-acfe-bb518d9dd49a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:59.791957 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-b110b06c-f735-4406-acfe-bb518d9dd49a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:14:59.793265 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-b110b06c-f735-4406-acfe-bb518d9dd49a tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1740 microversion: 2.20 time: 0.169776 Sep 02 17:14:59.793548 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-55566213-2e10-4d93-9fcc-449c078c091b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:14:59.796880 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-55566213-2e10-4d93-9fcc-449c078c091b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:14:59.803232 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-55566213-2e10-4d93-9fcc-449c078c091b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:59.804017 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-55566213-2e10-4d93-9fcc-449c078c091b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:59.804691 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 550/1040] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:14:59 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:14:59.805228 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-55566213-2e10-4d93-9fcc-449c078c091b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:14:59.805666 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-55566213-2e10-4d93-9fcc-449c078c091b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:14:59.903563 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-55566213-2e10-4d93-9fcc-449c078c091b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.114045 Sep 02 17:14:59.904269 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 491/1041] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:14:59 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:15:00.812454 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-bb310d20-acdf-41c7-9912-36ca4563ef3e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:00.813723 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-bb310d20-acdf-41c7-9912-36ca4563ef3e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:00.820076 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bb310d20-acdf-41c7-9912-36ca4563ef3e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:00.820532 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bb310d20-acdf-41c7-9912-36ca4563ef3e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:00.821311 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bb310d20-acdf-41c7-9912-36ca4563ef3e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:00.821745 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bb310d20-acdf-41c7-9912-36ca4563ef3e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:00.921138 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-a0d351b7-fefa-4664-9f30-f125fe0e2af1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:15:00.922132 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-a0d351b7-fefa-4664-9f30-f125fe0e2af1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:00.928842 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a0d351b7-fefa-4664-9f30-f125fe0e2af1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:00.929290 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a0d351b7-fefa-4664-9f30-f125fe0e2af1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:00.930064 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a0d351b7-fefa-4664-9f30-f125fe0e2af1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:00.930497 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a0d351b7-fefa-4664-9f30-f125fe0e2af1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:00.957841 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-bb310d20-acdf-41c7-9912-36ca4563ef3e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:00.967878 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-bb310d20-acdf-41c7-9912-36ca4563ef3e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:00.969368 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-bb310d20-acdf-41c7-9912-36ca4563ef3e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:00.970926 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-bb310d20-acdf-41c7-9912-36ca4563ef3e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1740 microversion: 2.20 time: 0.162118 Sep 02 17:15:00.971461 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 551/1042] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:15:00 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:15:01.037752 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-a0d351b7-fefa-4664-9f30-f125fe0e2af1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.122269 Sep 02 17:15:01.044292 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 492/1043] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:15:00 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:15:01.989599 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-b693e4ae-a54a-43b9-87c5-a70784fc93e7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:01.991528 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-b693e4ae-a54a-43b9-87c5-a70784fc93e7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:01.998147 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b693e4ae-a54a-43b9-87c5-a70784fc93e7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:01.998721 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b693e4ae-a54a-43b9-87c5-a70784fc93e7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:01.999570 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b693e4ae-a54a-43b9-87c5-a70784fc93e7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:02.000101 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b693e4ae-a54a-43b9-87c5-a70784fc93e7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:02.054677 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-7cc137d0-54f0-4f9a-9ea4-04114fff536b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:15:02.055873 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-7cc137d0-54f0-4f9a-9ea4-04114fff536b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:02.063260 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7cc137d0-54f0-4f9a-9ea4-04114fff536b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:02.064200 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7cc137d0-54f0-4f9a-9ea4-04114fff536b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:02.065057 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7cc137d0-54f0-4f9a-9ea4-04114fff536b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:02.065491 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7cc137d0-54f0-4f9a-9ea4-04114fff536b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:02.137566 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-b693e4ae-a54a-43b9-87c5-a70784fc93e7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:02.145552 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-b693e4ae-a54a-43b9-87c5-a70784fc93e7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:02.147076 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-b693e4ae-a54a-43b9-87c5-a70784fc93e7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:02.148233 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-b693e4ae-a54a-43b9-87c5-a70784fc93e7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1740 microversion: 2.20 time: 0.162579 Sep 02 17:15:02.160727 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 552/1044] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:15:01 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:15:02.169080 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-7cc137d0-54f0-4f9a-9ea4-04114fff536b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.120425 Sep 02 17:15:02.169829 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 493/1045] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:15:02 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:15:03.168697 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-b3870294-9df2-4eea-8947-fb385b0073c8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:03.169299 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-b3870294-9df2-4eea-8947-fb385b0073c8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:03.175937 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b3870294-9df2-4eea-8947-fb385b0073c8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:03.176127 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b3870294-9df2-4eea-8947-fb385b0073c8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:03.177018 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b3870294-9df2-4eea-8947-fb385b0073c8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:03.177713 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b3870294-9df2-4eea-8947-fb385b0073c8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:03.184870 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-44d48c3b-0b26-4908-a223-7dbf90e6699b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:15:03.186574 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-44d48c3b-0b26-4908-a223-7dbf90e6699b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:03.193675 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-44d48c3b-0b26-4908-a223-7dbf90e6699b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:03.194126 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-44d48c3b-0b26-4908-a223-7dbf90e6699b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:03.194936 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-44d48c3b-0b26-4908-a223-7dbf90e6699b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:03.195547 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-44d48c3b-0b26-4908-a223-7dbf90e6699b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:03.304754 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-44d48c3b-0b26-4908-a223-7dbf90e6699b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.124475 Sep 02 17:15:03.305678 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 494/1046] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:15:03 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:15:03.323118 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-b3870294-9df2-4eea-8947-fb385b0073c8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:03.331894 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-b3870294-9df2-4eea-8947-fb385b0073c8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:03.333457 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-b3870294-9df2-4eea-8947-fb385b0073c8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:03.334734 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-b3870294-9df2-4eea-8947-fb385b0073c8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1740 microversion: 2.20 time: 0.170424 Sep 02 17:15:03.335350 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 553/1047] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:15:03 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:15:04.318142 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-d4ee5469-e721-4de1-89fd-2a97056be5f7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:15:04.319177 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-d4ee5469-e721-4de1-89fd-2a97056be5f7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:04.326324 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d4ee5469-e721-4de1-89fd-2a97056be5f7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:04.326792 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d4ee5469-e721-4de1-89fd-2a97056be5f7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:04.327566 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d4ee5469-e721-4de1-89fd-2a97056be5f7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:04.327996 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d4ee5469-e721-4de1-89fd-2a97056be5f7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:04.352797 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-65613418-e172-40b4-858e-980f4669df10 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:04.353386 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-65613418-e172-40b4-858e-980f4669df10 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:04.360832 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-65613418-e172-40b4-858e-980f4669df10 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:04.361274 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-65613418-e172-40b4-858e-980f4669df10 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:04.362046 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-65613418-e172-40b4-858e-980f4669df10 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:04.362474 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-65613418-e172-40b4-858e-980f4669df10 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:04.436823 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-d4ee5469-e721-4de1-89fd-2a97056be5f7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.122341 Sep 02 17:15:04.443716 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 495/1048] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:15:04 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:15:04.522319 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-65613418-e172-40b4-858e-980f4669df10 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:04.530800 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-65613418-e172-40b4-858e-980f4669df10 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:04.532538 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-65613418-e172-40b4-858e-980f4669df10 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:04.533580 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-65613418-e172-40b4-858e-980f4669df10 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1740 microversion: 2.20 time: 0.184515 Sep 02 17:15:04.534362 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 554/1049] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:15:04 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:15:05.451279 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-ab172677-0c3e-4773-9e7a-9042f3135df1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:15:05.452273 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-ab172677-0c3e-4773-9e7a-9042f3135df1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:05.458669 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ab172677-0c3e-4773-9e7a-9042f3135df1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:05.459122 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ab172677-0c3e-4773-9e7a-9042f3135df1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:05.459886 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ab172677-0c3e-4773-9e7a-9042f3135df1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:05.460321 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ab172677-0c3e-4773-9e7a-9042f3135df1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:05.551420 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-09ca9a23-ef71-451b-bab4-185d6e5c91b2 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:05.552024 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-09ca9a23-ef71-451b-bab4-185d6e5c91b2 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:05.557734 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-09ca9a23-ef71-451b-bab4-185d6e5c91b2 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:05.558178 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-09ca9a23-ef71-451b-bab4-185d6e5c91b2 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:05.558963 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-09ca9a23-ef71-451b-bab4-185d6e5c91b2 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:05.559393 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-09ca9a23-ef71-451b-bab4-185d6e5c91b2 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:05.650979 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-ab172677-0c3e-4773-9e7a-9042f3135df1 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.204271 Sep 02 17:15:05.652750 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 496/1050] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:15:05 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:15:05.681623 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-09ca9a23-ef71-451b-bab4-185d6e5c91b2 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:05.689520 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-09ca9a23-ef71-451b-bab4-185d6e5c91b2 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:05.691040 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-09ca9a23-ef71-451b-bab4-185d6e5c91b2 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:05.692197 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-09ca9a23-ef71-451b-bab4-185d6e5c91b2 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1740 microversion: 2.20 time: 0.144487 Sep 02 17:15:05.692743 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 555/1051] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:15:05 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1740 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:15:06.664145 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-f5f644aa-df77-4a22-a5fa-5d1ed1ffa869 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:15:06.665136 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-f5f644aa-df77-4a22-a5fa-5d1ed1ffa869 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:06.671612 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f5f644aa-df77-4a22-a5fa-5d1ed1ffa869 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:06.672064 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f5f644aa-df77-4a22-a5fa-5d1ed1ffa869 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:06.672825 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f5f644aa-df77-4a22-a5fa-5d1ed1ffa869 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:06.673260 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f5f644aa-df77-4a22-a5fa-5d1ed1ffa869 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:06.712053 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-f26dd188-2172-40aa-8d5f-1ba7a420c30f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:06.712656 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-f26dd188-2172-40aa-8d5f-1ba7a420c30f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:06.718858 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f26dd188-2172-40aa-8d5f-1ba7a420c30f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:06.719305 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f26dd188-2172-40aa-8d5f-1ba7a420c30f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:06.720068 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f26dd188-2172-40aa-8d5f-1ba7a420c30f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:06.720498 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f26dd188-2172-40aa-8d5f-1ba7a420c30f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:06.763944 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-f5f644aa-df77-4a22-a5fa-5d1ed1ffa869 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.103599 Sep 02 17:15:06.768072 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 497/1052] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:15:06 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:15:06.851198 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-f26dd188-2172-40aa-8d5f-1ba7a420c30f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:06.858920 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-f26dd188-2172-40aa-8d5f-1ba7a420c30f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:06.860396 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-f26dd188-2172-40aa-8d5f-1ba7a420c30f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:06.861527 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-f26dd188-2172-40aa-8d5f-1ba7a420c30f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1722 microversion: 2.20 time: 0.153170 Sep 02 17:15:06.862073 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 556/1053] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:15:06 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:15:07.776265 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-9dd3b59f-968c-40de-821c-ea6696f5b447 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:15:07.777765 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-9dd3b59f-968c-40de-821c-ea6696f5b447 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:07.784228 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9dd3b59f-968c-40de-821c-ea6696f5b447 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:07.784674 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9dd3b59f-968c-40de-821c-ea6696f5b447 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:07.785434 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9dd3b59f-968c-40de-821c-ea6696f5b447 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:07.785869 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9dd3b59f-968c-40de-821c-ea6696f5b447 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:07.871474 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-9dd3b59f-968c-40de-821c-ea6696f5b447 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.099036 Sep 02 17:15:07.872116 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 498/1054] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:15:07 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:15:07.879626 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-553d11a3-2392-41be-8c02-0e18b475ef52 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:07.880263 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-553d11a3-2392-41be-8c02-0e18b475ef52 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:07.886543 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-553d11a3-2392-41be-8c02-0e18b475ef52 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:07.887032 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-553d11a3-2392-41be-8c02-0e18b475ef52 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:07.887873 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-553d11a3-2392-41be-8c02-0e18b475ef52 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:07.888332 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-553d11a3-2392-41be-8c02-0e18b475ef52 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:08.006520 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-553d11a3-2392-41be-8c02-0e18b475ef52 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:08.014585 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-553d11a3-2392-41be-8c02-0e18b475ef52 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:08.016110 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-553d11a3-2392-41be-8c02-0e18b475ef52 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:08.017253 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-553d11a3-2392-41be-8c02-0e18b475ef52 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1722 microversion: 2.20 time: 0.141350 Sep 02 17:15:08.017795 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 557/1055] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:15:07 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1722 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:15:08.531804 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-06cb87f0-8eed-48af-bb95-c8dcd71422f6 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:08.532309 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-06cb87f0-8eed-48af-bb95-c8dcd71422f6 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:08.538899 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-06cb87f0-8eed-48af-bb95-c8dcd71422f6 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:08.539347 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-06cb87f0-8eed-48af-bb95-c8dcd71422f6 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:08.540111 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-06cb87f0-8eed-48af-bb95-c8dcd71422f6 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:08.540575 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-06cb87f0-8eed-48af-bb95-c8dcd71422f6 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:08.564787 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-06cb87f0-8eed-48af-bb95-c8dcd71422f6 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Going to try to terminate instance {{(pid=108417) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 17:15:08.638388 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-06cb87f0-8eed-48af-bb95-c8dcd71422f6 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "DELETE /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 204 len: 0 microversion: 2.1 time: 0.110388 Sep 02 17:15:08.642001 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 499/1056] 10.222.0.41 () {58 vars in 1239 bytes} [Thu Sep 2 17:15:08 2021] DELETE /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 17:15:08.651407 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-534b64ed-faab-406e-ab58-a75aa872fd61 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:08.652691 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-534b64ed-faab-406e-ab58-a75aa872fd61 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:08.658562 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-534b64ed-faab-406e-ab58-a75aa872fd61 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:08.659115 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-534b64ed-faab-406e-ab58-a75aa872fd61 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:08.659878 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-534b64ed-faab-406e-ab58-a75aa872fd61 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:08.660319 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-534b64ed-faab-406e-ab58-a75aa872fd61 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:08.797253 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-534b64ed-faab-406e-ab58-a75aa872fd61 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:08.805329 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-534b64ed-faab-406e-ab58-a75aa872fd61 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1575 microversion: 2.1 time: 0.157491 Sep 02 17:15:08.805944 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 558/1057] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:15:08 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:15:08.883989 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-71ed4b24-dba3-4420-897e-7d7daf57a419 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:15:08.885043 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-71ed4b24-dba3-4420-897e-7d7daf57a419 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:08.891466 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-71ed4b24-dba3-4420-897e-7d7daf57a419 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:08.891907 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-71ed4b24-dba3-4420-897e-7d7daf57a419 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:08.892666 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-71ed4b24-dba3-4420-897e-7d7daf57a419 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:08.893102 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-71ed4b24-dba3-4420-897e-7d7daf57a419 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:08.988186 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-71ed4b24-dba3-4420-897e-7d7daf57a419 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.108109 Sep 02 17:15:08.988833 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 500/1058] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:15:08 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:15:09.035443 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-4b3afd2f-3d08-431c-af3d-cc0131fd27a0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:09.036048 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-4b3afd2f-3d08-431c-af3d-cc0131fd27a0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:09.041930 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4b3afd2f-3d08-431c-af3d-cc0131fd27a0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:09.042380 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4b3afd2f-3d08-431c-af3d-cc0131fd27a0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:09.043176 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4b3afd2f-3d08-431c-af3d-cc0131fd27a0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:09.043675 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4b3afd2f-3d08-431c-af3d-cc0131fd27a0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:09.173772 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-4b3afd2f-3d08-431c-af3d-cc0131fd27a0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:09.181625 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-4b3afd2f-3d08-431c-af3d-cc0131fd27a0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:09.183790 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-4b3afd2f-3d08-431c-af3d-cc0131fd27a0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:09.184979 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-4b3afd2f-3d08-431c-af3d-cc0131fd27a0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1665 microversion: 2.20 time: 0.153226 Sep 02 17:15:09.185544 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 559/1059] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:15:09 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1665 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:15:09.208130 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-20d1791e-de77-48f1-bf5b-23c3f332e373 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44c360ca-c1f6-4988-969b-470711fc65c9"}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:15:09.209252 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-20d1791e-de77-48f1-bf5b-23c3f332e373 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:09.218112 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-20d1791e-de77-48f1-bf5b-23c3f332e373 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:09.218558 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-20d1791e-de77-48f1-bf5b-23c3f332e373 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:09.219353 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-20d1791e-de77-48f1-bf5b-23c3f332e373 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:09.219787 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-20d1791e-de77-48f1-bf5b-23c3f332e373 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:09.486461 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-20d1791e-de77-48f1-bf5b-23c3f332e373 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.282484 Sep 02 17:15:09.487176 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 501/1060] 10.222.0.41 () {62 vars in 1364 bytes} [Thu Sep 2 17:15:09 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/os-volume_attachments => generated 188 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:15:09.605783 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-b3e9578c-f267-4fd1-934c-7a92d9fffe88 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:09.606309 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-b3e9578c-f267-4fd1-934c-7a92d9fffe88 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:09.612047 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b3e9578c-f267-4fd1-934c-7a92d9fffe88 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:09.612529 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b3e9578c-f267-4fd1-934c-7a92d9fffe88 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:09.613288 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b3e9578c-f267-4fd1-934c-7a92d9fffe88 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:09.613723 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b3e9578c-f267-4fd1-934c-7a92d9fffe88 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:09.825445 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-ef785b56-53d0-4d45-9104-ad0cfd72790d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:09.826050 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-ef785b56-53d0-4d45-9104-ad0cfd72790d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:09.832161 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ef785b56-53d0-4d45-9104-ad0cfd72790d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:09.833527 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ef785b56-53d0-4d45-9104-ad0cfd72790d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:09.835197 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ef785b56-53d0-4d45-9104-ad0cfd72790d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:09.835807 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ef785b56-53d0-4d45-9104-ad0cfd72790d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:09.884990 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-b3e9578c-f267-4fd1-934c-7a92d9fffe88 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "DELETE /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/os-volume_attachments/44c360ca-c1f6-4988-969b-470711fc65c9" status: 202 len: 0 microversion: 2.20 time: 0.283493 Sep 02 17:15:09.885836 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 560/1061] 10.222.0.41 () {60 vars in 1457 bytes} [Thu Sep 2 17:15:09 2021] DELETE /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/os-volume_attachments/44c360ca-c1f6-4988-969b-470711fc65c9 => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 02 17:15:09.951403 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-df13ba83-52d4-4140-9d14-d60eb5b0c8c7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:15:09.951969 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-df13ba83-52d4-4140-9d14-d60eb5b0c8c7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:09.957896 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-df13ba83-52d4-4140-9d14-d60eb5b0c8c7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:09.958209 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-df13ba83-52d4-4140-9d14-d60eb5b0c8c7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:09.959142 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-df13ba83-52d4-4140-9d14-d60eb5b0c8c7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:09.959621 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-df13ba83-52d4-4140-9d14-d60eb5b0c8c7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:09.979409 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-ef785b56-53d0-4d45-9104-ad0cfd72790d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:09.991165 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-ef785b56-53d0-4d45-9104-ad0cfd72790d tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1575 microversion: 2.1 time: 0.169478 Sep 02 17:15:09.992165 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 502/1062] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:15:09 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:15:09.999652 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [req-73c0497c-eaa9-4592-b151-e5fa7a0b6285 req-e97dfa49-46a1-4875-aa33-24fcdefbb35e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41c895d8-bf14-4b23-8657-02bf702bb50c", "name": "network-vif-unplugged", "status": "completed", "tag": "88ce9e99-9c0c-4984-9fbe-83639825e7cc"}]} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:15:10.001446 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:15:10.001446 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: warnings.warn(msg) Sep 02 17:15:10.008798 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-73c0497c-eaa9-4592-b151-e5fa7a0b6285 req-e97dfa49-46a1-4875-aa33-24fcdefbb35e service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:10.009236 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-73c0497c-eaa9-4592-b151-e5fa7a0b6285 req-e97dfa49-46a1-4875-aa33-24fcdefbb35e service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:10.025317 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.compute.server_external_events [req-73c0497c-eaa9-4592-b151-e5fa7a0b6285 req-e97dfa49-46a1-4875-aa33-24fcdefbb35e service nova] Unable to find a host for instance 41c895d8-bf14-4b23-8657-02bf702bb50c. Dropping event network-vif-unplugged {{(pid=108417) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Sep 02 17:15:10.026190 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [req-73c0497c-eaa9-4592-b151-e5fa7a0b6285 req-e97dfa49-46a1-4875-aa33-24fcdefbb35e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032969 Sep 02 17:15:10.026865 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 503/1063] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:15:09 2021] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 02 17:15:10.031747 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-36c2e870-3447-40ab-b6d4-08399fe26112 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:15:10.032640 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-36c2e870-3447-40ab-b6d4-08399fe26112 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:10.038478 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-36c2e870-3447-40ab-b6d4-08399fe26112 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:10.038982 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-36c2e870-3447-40ab-b6d4-08399fe26112 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:10.039765 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-36c2e870-3447-40ab-b6d4-08399fe26112 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:10.040203 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-36c2e870-3447-40ab-b6d4-08399fe26112 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:10.045247 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-df13ba83-52d4-4140-9d14-d60eb5b0c8c7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action" status: 202 len: 0 microversion: 2.20 time: 0.097912 Sep 02 17:15:10.049727 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 561/1064] 10.222.0.41 () {62 vars in 1319 bytes} [Thu Sep 2 17:15:09 2021] POST /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 02 17:15:10.054859 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-a4ff8581-94cd-4f86-b4e8-85b6e44d5024 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:10.055671 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-a4ff8581-94cd-4f86-b4e8-85b6e44d5024 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:10.062181 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a4ff8581-94cd-4f86-b4e8-85b6e44d5024 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:10.062734 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a4ff8581-94cd-4f86-b4e8-85b6e44d5024 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:10.063717 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a4ff8581-94cd-4f86-b4e8-85b6e44d5024 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:10.064264 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a4ff8581-94cd-4f86-b4e8-85b6e44d5024 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:10.143986 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-36c2e870-3447-40ab-b6d4-08399fe26112 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.115314 Sep 02 17:15:10.144640 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 504/1065] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:15:10 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:15:10.193842 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-a4ff8581-94cd-4f86-b4e8-85b6e44d5024 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:10.202227 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-a4ff8581-94cd-4f86-b4e8-85b6e44d5024 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:10.203983 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-a4ff8581-94cd-4f86-b4e8-85b6e44d5024 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:10.205166 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-a4ff8581-94cd-4f86-b4e8-85b6e44d5024 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1673 microversion: 2.20 time: 0.154409 Sep 02 17:15:10.205703 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 562/1066] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:15:10 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:15:11.008326 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-9557cbc7-8094-4e77-804b-43df0d799bff tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:11.009019 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-9557cbc7-8094-4e77-804b-43df0d799bff tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:11.015997 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9557cbc7-8094-4e77-804b-43df0d799bff tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:11.016443 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9557cbc7-8094-4e77-804b-43df0d799bff tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:11.017211 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9557cbc7-8094-4e77-804b-43df0d799bff tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:11.017648 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9557cbc7-8094-4e77-804b-43df0d799bff tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:11.156868 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-8d6ae7ae-331d-45e5-9ed8-ffa203a44f40 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:15:11.158171 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-8d6ae7ae-331d-45e5-9ed8-ffa203a44f40 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:11.164780 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8d6ae7ae-331d-45e5-9ed8-ffa203a44f40 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:11.165440 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8d6ae7ae-331d-45e5-9ed8-ffa203a44f40 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:11.166407 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8d6ae7ae-331d-45e5-9ed8-ffa203a44f40 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:11.167002 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8d6ae7ae-331d-45e5-9ed8-ffa203a44f40 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:11.206993 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-9557cbc7-8094-4e77-804b-43df0d799bff tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:11.215817 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-9557cbc7-8094-4e77-804b-43df0d799bff tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1575 microversion: 2.1 time: 0.211415 Sep 02 17:15:11.216471 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 505/1067] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:15:11 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1575 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:15:11.223250 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-dd387ffd-92e2-433b-bac2-5a3b1068b7b5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:11.224247 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-dd387ffd-92e2-433b-bac2-5a3b1068b7b5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:11.230574 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-dd387ffd-92e2-433b-bac2-5a3b1068b7b5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:11.231396 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-dd387ffd-92e2-433b-bac2-5a3b1068b7b5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:11.232463 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-dd387ffd-92e2-433b-bac2-5a3b1068b7b5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:11.233114 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-dd387ffd-92e2-433b-bac2-5a3b1068b7b5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:11.256764 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-8d6ae7ae-331d-45e5-9ed8-ffa203a44f40 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.103565 Sep 02 17:15:11.257333 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 563/1068] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:15:11 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:15:11.444311 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-dd387ffd-92e2-433b-bac2-5a3b1068b7b5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:11.453570 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-dd387ffd-92e2-433b-bac2-5a3b1068b7b5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:11.455089 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-dd387ffd-92e2-433b-bac2-5a3b1068b7b5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:11.456269 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-dd387ffd-92e2-433b-bac2-5a3b1068b7b5 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1731 microversion: 2.20 time: 0.236882 Sep 02 17:15:11.456875 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 506/1069] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:15:11 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1731 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:15:11.852991 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-ad5e6a1b-e224-4102-af78-86f2456fe13c req-85c2b0b5-5eea-41c9-b63d-dc3c64bd85f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34e36f29-2bc8-4586-8de2-3a218984c046", "name": "network-vif-deleted", "tag": "1af31c9b-4bff-4dc7-8b17-98d43795b25a"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:15:11.854390 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:15:11.854390 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:15:11.862870 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-ad5e6a1b-e224-4102-af78-86f2456fe13c req-85c2b0b5-5eea-41c9-b63d-dc3c64bd85f7 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:11.863554 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-ad5e6a1b-e224-4102-af78-86f2456fe13c req-85c2b0b5-5eea-41c9-b63d-dc3c64bd85f7 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:11.889773 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-ad5e6a1b-e224-4102-af78-86f2456fe13c req-85c2b0b5-5eea-41c9-b63d-dc3c64bd85f7 service nova] Creating event network-vif-deleted:1af31c9b-4bff-4dc7-8b17-98d43795b25a for instance 34e36f29-2bc8-4586-8de2-3a218984c046 on hv-cinder-80626 Sep 02 17:15:11.896403 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-ad5e6a1b-e224-4102-af78-86f2456fe13c req-85c2b0b5-5eea-41c9-b63d-dc3c64bd85f7 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112665 Sep 02 17:15:11.898796 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 564/1070] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:15:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:15:12.235422 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-4fcbbd00-a055-4653-93e0-365872f0c675 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:12.236695 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-4fcbbd00-a055-4653-93e0-365872f0c675 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:12.244487 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4fcbbd00-a055-4653-93e0-365872f0c675 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:12.244937 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4fcbbd00-a055-4653-93e0-365872f0c675 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:12.246484 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4fcbbd00-a055-4653-93e0-365872f0c675 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:12.247127 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4fcbbd00-a055-4653-93e0-365872f0c675 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:12.268989 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-4b8b9590-0b74-4e70-aa0e-541db8410a18 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:15:12.269991 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-4b8b9590-0b74-4e70-aa0e-541db8410a18 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:12.280724 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4b8b9590-0b74-4e70-aa0e-541db8410a18 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:12.281173 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4b8b9590-0b74-4e70-aa0e-541db8410a18 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:12.283384 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4b8b9590-0b74-4e70-aa0e-541db8410a18 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:12.283829 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4b8b9590-0b74-4e70-aa0e-541db8410a18 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:12.288488 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4fcbbd00-a055-4653-93e0-365872f0c675 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:12.289273 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4fcbbd00-a055-4653-93e0-365872f0c675 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:12.290079 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.objects.instance [None req-4fcbbd00-a055-4653-93e0-365872f0c675 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lazy-loading 'fault' on Instance uuid 34e36f29-2bc8-4586-8de2-3a218984c046 {{(pid=108417) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 17:15:12.336991 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-4fcbbd00-a055-4653-93e0-365872f0c675 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:12.347445 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-4fcbbd00-a055-4653-93e0-365872f0c675 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1231 microversion: 2.1 time: 0.117827 Sep 02 17:15:12.348721 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 507/1071] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:15:12 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1231 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:15:12.400888 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-4b8b9590-0b74-4e70-aa0e-541db8410a18 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.135680 Sep 02 17:15:12.401573 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 565/1072] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:15:12 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:15:12.475865 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-c6502462-2bf4-4445-b926-7cba07d3bf0c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:12.476084 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-c6502462-2bf4-4445-b926-7cba07d3bf0c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:12.482132 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c6502462-2bf4-4445-b926-7cba07d3bf0c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:12.483191 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c6502462-2bf4-4445-b926-7cba07d3bf0c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:12.484144 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c6502462-2bf4-4445-b926-7cba07d3bf0c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:12.484578 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c6502462-2bf4-4445-b926-7cba07d3bf0c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:12.621690 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-c6502462-2bf4-4445-b926-7cba07d3bf0c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:12.647082 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-c6502462-2bf4-4445-b926-7cba07d3bf0c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:12.649990 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-c6502462-2bf4-4445-b926-7cba07d3bf0c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:12.652201 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-c6502462-2bf4-4445-b926-7cba07d3bf0c tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1731 microversion: 2.20 time: 0.180092 Sep 02 17:15:12.664465 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 508/1073] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:15:12 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1731 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:15:13.365420 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-e1b1673e-e451-4dbf-a54b-7d31e33e1712 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:13.366127 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-e1b1673e-e451-4dbf-a54b-7d31e33e1712 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:13.373973 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e1b1673e-e451-4dbf-a54b-7d31e33e1712 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:13.374426 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e1b1673e-e451-4dbf-a54b-7d31e33e1712 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:13.375247 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e1b1673e-e451-4dbf-a54b-7d31e33e1712 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:13.375691 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e1b1673e-e451-4dbf-a54b-7d31e33e1712 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:13.407881 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e1b1673e-e451-4dbf-a54b-7d31e33e1712 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:13.408317 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e1b1673e-e451-4dbf-a54b-7d31e33e1712 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:13.408761 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.objects.instance [None req-e1b1673e-e451-4dbf-a54b-7d31e33e1712 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lazy-loading 'fault' on Instance uuid 34e36f29-2bc8-4586-8de2-3a218984c046 {{(pid=108418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 17:15:13.412194 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-c20893c2-89a4-4804-b696-2ac32e438c9e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:15:13.413103 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-c20893c2-89a4-4804-b696-2ac32e438c9e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:13.419513 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c20893c2-89a4-4804-b696-2ac32e438c9e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:13.420215 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c20893c2-89a4-4804-b696-2ac32e438c9e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:13.421181 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c20893c2-89a4-4804-b696-2ac32e438c9e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:13.421618 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c20893c2-89a4-4804-b696-2ac32e438c9e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:13.452714 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-e1b1673e-e451-4dbf-a54b-7d31e33e1712 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:13.460429 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-e1b1673e-e451-4dbf-a54b-7d31e33e1712 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1231 microversion: 2.1 time: 0.099468 Sep 02 17:15:13.461000 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 566/1074] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:15:13 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1231 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:15:13.670974 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-36a29f81-2b7e-4d57-981e-617319c171ba tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:13.671726 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-36a29f81-2b7e-4d57-981e-617319c171ba tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:13.677579 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-36a29f81-2b7e-4d57-981e-617319c171ba tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:13.678027 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-36a29f81-2b7e-4d57-981e-617319c171ba tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:13.678824 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-36a29f81-2b7e-4d57-981e-617319c171ba tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:13.679337 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-36a29f81-2b7e-4d57-981e-617319c171ba tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:13.807162 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-36a29f81-2b7e-4d57-981e-617319c171ba tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:13.815607 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-36a29f81-2b7e-4d57-981e-617319c171ba tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:13.817140 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-36a29f81-2b7e-4d57-981e-617319c171ba tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:13.818234 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-36a29f81-2b7e-4d57-981e-617319c171ba tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1731 microversion: 2.20 time: 0.151626 Sep 02 17:15:13.818996 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 567/1075] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:15:13 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:15:14.476792 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-ea2c03e1-1afa-41c9-95f5-f47c56b11ea0 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:14.477645 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-ea2c03e1-1afa-41c9-95f5-f47c56b11ea0 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:14.483879 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ea2c03e1-1afa-41c9-95f5-f47c56b11ea0 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:14.484328 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ea2c03e1-1afa-41c9-95f5-f47c56b11ea0 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:14.485098 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ea2c03e1-1afa-41c9-95f5-f47c56b11ea0 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:14.485539 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ea2c03e1-1afa-41c9-95f5-f47c56b11ea0 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:14.518603 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ea2c03e1-1afa-41c9-95f5-f47c56b11ea0 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:14.518992 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ea2c03e1-1afa-41c9-95f5-f47c56b11ea0 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:14.519766 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.objects.instance [None req-ea2c03e1-1afa-41c9-95f5-f47c56b11ea0 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lazy-loading 'fault' on Instance uuid 34e36f29-2bc8-4586-8de2-3a218984c046 {{(pid=108418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 17:15:14.562976 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-ea2c03e1-1afa-41c9-95f5-f47c56b11ea0 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:14.570337 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-ea2c03e1-1afa-41c9-95f5-f47c56b11ea0 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1231 microversion: 2.1 time: 0.097130 Sep 02 17:15:14.570923 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 568/1076] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:15:14 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1231 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:15:14.836607 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-4eab5c00-bc26-4ff4-84c8-d62cf1096209 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:14.837335 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-4eab5c00-bc26-4ff4-84c8-d62cf1096209 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:14.846798 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4eab5c00-bc26-4ff4-84c8-d62cf1096209 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:14.847246 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4eab5c00-bc26-4ff4-84c8-d62cf1096209 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:14.848030 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4eab5c00-bc26-4ff4-84c8-d62cf1096209 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:14.848464 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4eab5c00-bc26-4ff4-84c8-d62cf1096209 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:14.985996 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-4eab5c00-bc26-4ff4-84c8-d62cf1096209 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:14.996728 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-4eab5c00-bc26-4ff4-84c8-d62cf1096209 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:14.998398 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-4eab5c00-bc26-4ff4-84c8-d62cf1096209 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:14.999613 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-4eab5c00-bc26-4ff4-84c8-d62cf1096209 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1731 microversion: 2.20 time: 0.167068 Sep 02 17:15:15.000371 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 569/1077] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:15:14 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:15:15.587417 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-08a5bfb8-4083-4b5e-9e99-3282a7622c44 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:15.588096 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-08a5bfb8-4083-4b5e-9e99-3282a7622c44 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:15.594466 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-08a5bfb8-4083-4b5e-9e99-3282a7622c44 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:15.594948 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-08a5bfb8-4083-4b5e-9e99-3282a7622c44 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:15.595714 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-08a5bfb8-4083-4b5e-9e99-3282a7622c44 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:15.596147 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-08a5bfb8-4083-4b5e-9e99-3282a7622c44 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:15.627394 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-08a5bfb8-4083-4b5e-9e99-3282a7622c44 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:15.628006 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-08a5bfb8-4083-4b5e-9e99-3282a7622c44 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:15.628552 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.objects.instance [None req-08a5bfb8-4083-4b5e-9e99-3282a7622c44 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lazy-loading 'fault' on Instance uuid 34e36f29-2bc8-4586-8de2-3a218984c046 {{(pid=108418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 17:15:15.667907 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-08a5bfb8-4083-4b5e-9e99-3282a7622c44 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:15.675925 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-08a5bfb8-4083-4b5e-9e99-3282a7622c44 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1231 microversion: 2.1 time: 0.092145 Sep 02 17:15:15.676504 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 570/1078] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:15:15 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1231 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:15:16.017191 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-2af6f584-6654-4588-b691-ea1712dfa0ec tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:16.018038 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-2af6f584-6654-4588-b691-ea1712dfa0ec tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:16.024658 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2af6f584-6654-4588-b691-ea1712dfa0ec tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:16.025113 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2af6f584-6654-4588-b691-ea1712dfa0ec tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:16.025895 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2af6f584-6654-4588-b691-ea1712dfa0ec tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:16.026333 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2af6f584-6654-4588-b691-ea1712dfa0ec tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:16.164611 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-2af6f584-6654-4588-b691-ea1712dfa0ec tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:16.172708 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-2af6f584-6654-4588-b691-ea1712dfa0ec tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:16.174188 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-2af6f584-6654-4588-b691-ea1712dfa0ec tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:16.175368 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-2af6f584-6654-4588-b691-ea1712dfa0ec tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1731 microversion: 2.20 time: 0.162028 Sep 02 17:15:16.175913 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 571/1079] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:15:16 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:15:16.692980 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-bf284395-3ef8-4da6-b570-0ab6059535cb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:16.693730 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-bf284395-3ef8-4da6-b570-0ab6059535cb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:16.700582 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bf284395-3ef8-4da6-b570-0ab6059535cb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:16.701031 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bf284395-3ef8-4da6-b570-0ab6059535cb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:16.701798 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bf284395-3ef8-4da6-b570-0ab6059535cb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:16.702224 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bf284395-3ef8-4da6-b570-0ab6059535cb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:16.734220 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bf284395-3ef8-4da6-b570-0ab6059535cb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:16.734689 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bf284395-3ef8-4da6-b570-0ab6059535cb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:16.735137 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.objects.instance [None req-bf284395-3ef8-4da6-b570-0ab6059535cb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lazy-loading 'fault' on Instance uuid 34e36f29-2bc8-4586-8de2-3a218984c046 {{(pid=108418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 17:15:16.775552 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-bf284395-3ef8-4da6-b570-0ab6059535cb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:16.783037 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-bf284395-3ef8-4da6-b570-0ab6059535cb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1231 microversion: 2.1 time: 0.093651 Sep 02 17:15:16.783594 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 572/1080] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:15:16 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1231 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:15:17.193640 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-92d32a4c-362f-47ba-b926-498b5381bcde tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:17.194397 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-92d32a4c-362f-47ba-b926-498b5381bcde tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:17.201882 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-92d32a4c-362f-47ba-b926-498b5381bcde tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:17.202419 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-92d32a4c-362f-47ba-b926-498b5381bcde tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:17.203302 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-92d32a4c-362f-47ba-b926-498b5381bcde tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:17.203812 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-92d32a4c-362f-47ba-b926-498b5381bcde tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:17.330274 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-92d32a4c-362f-47ba-b926-498b5381bcde tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:17.338406 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-92d32a4c-362f-47ba-b926-498b5381bcde tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:17.340233 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-92d32a4c-362f-47ba-b926-498b5381bcde tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:17.341730 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-92d32a4c-362f-47ba-b926-498b5381bcde tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1731 microversion: 2.20 time: 0.151855 Sep 02 17:15:17.342286 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 573/1081] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:15:17 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:15:17.800134 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-13eef118-9415-403c-93fb-5be07b8d19da tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:17.800844 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-13eef118-9415-403c-93fb-5be07b8d19da tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:17.806802 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-13eef118-9415-403c-93fb-5be07b8d19da tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:17.807257 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-13eef118-9415-403c-93fb-5be07b8d19da tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:17.808031 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-13eef118-9415-403c-93fb-5be07b8d19da tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:17.808469 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-13eef118-9415-403c-93fb-5be07b8d19da tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:17.839633 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-13eef118-9415-403c-93fb-5be07b8d19da tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:17.840082 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-13eef118-9415-403c-93fb-5be07b8d19da tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:17.840533 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.objects.instance [None req-13eef118-9415-403c-93fb-5be07b8d19da tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lazy-loading 'fault' on Instance uuid 34e36f29-2bc8-4586-8de2-3a218984c046 {{(pid=108418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 17:15:17.881134 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-13eef118-9415-403c-93fb-5be07b8d19da tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:17.889173 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-13eef118-9415-403c-93fb-5be07b8d19da tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1231 microversion: 2.1 time: 0.092705 Sep 02 17:15:17.889747 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 574/1082] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:15:17 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1231 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:15:18.360963 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-2844888a-3464-40c0-932d-fa84bdffe262 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:18.361703 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-2844888a-3464-40c0-932d-fa84bdffe262 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:18.368157 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2844888a-3464-40c0-932d-fa84bdffe262 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:18.368601 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2844888a-3464-40c0-932d-fa84bdffe262 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:18.369364 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2844888a-3464-40c0-932d-fa84bdffe262 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:18.369790 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2844888a-3464-40c0-932d-fa84bdffe262 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:18.495858 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-2844888a-3464-40c0-932d-fa84bdffe262 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:18.503763 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-2844888a-3464-40c0-932d-fa84bdffe262 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:18.505337 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-2844888a-3464-40c0-932d-fa84bdffe262 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:18.506925 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-2844888a-3464-40c0-932d-fa84bdffe262 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1731 microversion: 2.20 time: 0.150028 Sep 02 17:15:18.507360 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 575/1083] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:15:18 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:15:18.905730 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-018e2c92-4ec5-4877-91a9-32f462ea3140 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:18.906525 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-018e2c92-4ec5-4877-91a9-32f462ea3140 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:18.912370 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-018e2c92-4ec5-4877-91a9-32f462ea3140 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:18.912822 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-018e2c92-4ec5-4877-91a9-32f462ea3140 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:18.913653 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-018e2c92-4ec5-4877-91a9-32f462ea3140 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:18.914208 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-018e2c92-4ec5-4877-91a9-32f462ea3140 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:18.946459 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-018e2c92-4ec5-4877-91a9-32f462ea3140 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:18.946939 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-018e2c92-4ec5-4877-91a9-32f462ea3140 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:18.947394 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.objects.instance [None req-018e2c92-4ec5-4877-91a9-32f462ea3140 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lazy-loading 'fault' on Instance uuid 34e36f29-2bc8-4586-8de2-3a218984c046 {{(pid=108418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 17:15:18.988762 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-018e2c92-4ec5-4877-91a9-32f462ea3140 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:18.998499 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-018e2c92-4ec5-4877-91a9-32f462ea3140 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1231 microversion: 2.1 time: 0.096936 Sep 02 17:15:18.999320 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 576/1084] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:15:18 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1231 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:15:19.524872 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-6f53c045-41b2-4bb4-909f-26e3e54990ed tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:19.525400 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-6f53c045-41b2-4bb4-909f-26e3e54990ed tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:19.531446 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6f53c045-41b2-4bb4-909f-26e3e54990ed tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:19.531896 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6f53c045-41b2-4bb4-909f-26e3e54990ed tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:19.532668 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6f53c045-41b2-4bb4-909f-26e3e54990ed tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:19.533116 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6f53c045-41b2-4bb4-909f-26e3e54990ed tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:19.656263 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-6f53c045-41b2-4bb4-909f-26e3e54990ed tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:19.664332 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-6f53c045-41b2-4bb4-909f-26e3e54990ed tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:19.665812 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-6f53c045-41b2-4bb4-909f-26e3e54990ed tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:19.667533 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-6f53c045-41b2-4bb4-909f-26e3e54990ed tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1731 microversion: 2.20 time: 0.145998 Sep 02 17:15:19.668372 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 577/1085] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:15:19 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1731 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:15:20.023298 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-b067f1fc-d097-46de-93f8-d657380a669f tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:20.024119 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-b067f1fc-d097-46de-93f8-d657380a669f tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:20.042712 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b067f1fc-d097-46de-93f8-d657380a669f tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:20.043171 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b067f1fc-d097-46de-93f8-d657380a669f tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:20.043970 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b067f1fc-d097-46de-93f8-d657380a669f tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:20.044407 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b067f1fc-d097-46de-93f8-d657380a669f tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:20.077293 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b067f1fc-d097-46de-93f8-d657380a669f tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:20.077931 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b067f1fc-d097-46de-93f8-d657380a669f tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:20.078520 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.objects.instance [None req-b067f1fc-d097-46de-93f8-d657380a669f tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lazy-loading 'fault' on Instance uuid 34e36f29-2bc8-4586-8de2-3a218984c046 {{(pid=108418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 17:15:20.122739 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-b067f1fc-d097-46de-93f8-d657380a669f tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:20.130295 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-b067f1fc-d097-46de-93f8-d657380a669f tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1231 microversion: 2.1 time: 0.113467 Sep 02 17:15:20.130981 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 578/1086] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:15:20 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1231 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:15:20.686146 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-2b62edf5-39ae-4743-be0a-5eacf6c61fb7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:20.686942 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-2b62edf5-39ae-4743-be0a-5eacf6c61fb7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:20.692928 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2b62edf5-39ae-4743-be0a-5eacf6c61fb7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:20.693382 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2b62edf5-39ae-4743-be0a-5eacf6c61fb7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:20.694133 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2b62edf5-39ae-4743-be0a-5eacf6c61fb7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:20.694559 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2b62edf5-39ae-4743-be0a-5eacf6c61fb7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:20.820478 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-2b62edf5-39ae-4743-be0a-5eacf6c61fb7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:20.830132 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-2b62edf5-39ae-4743-be0a-5eacf6c61fb7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:20.831647 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-2b62edf5-39ae-4743-be0a-5eacf6c61fb7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:20.832812 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-2b62edf5-39ae-4743-be0a-5eacf6c61fb7 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1731 microversion: 2.20 time: 0.150906 Sep 02 17:15:20.833356 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 579/1087] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:15:20 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:15:21.147408 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-a961ac1c-a7ab-4bb7-8880-6a99699b3bf0 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:21.148113 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-a961ac1c-a7ab-4bb7-8880-6a99699b3bf0 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:21.154238 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a961ac1c-a7ab-4bb7-8880-6a99699b3bf0 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:21.154720 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a961ac1c-a7ab-4bb7-8880-6a99699b3bf0 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:21.155499 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a961ac1c-a7ab-4bb7-8880-6a99699b3bf0 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:21.155936 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a961ac1c-a7ab-4bb7-8880-6a99699b3bf0 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:21.187354 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a961ac1c-a7ab-4bb7-8880-6a99699b3bf0 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:21.187792 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a961ac1c-a7ab-4bb7-8880-6a99699b3bf0 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:21.188227 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.objects.instance [None req-a961ac1c-a7ab-4bb7-8880-6a99699b3bf0 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lazy-loading 'fault' on Instance uuid 34e36f29-2bc8-4586-8de2-3a218984c046 {{(pid=108418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 17:15:21.230588 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-a961ac1c-a7ab-4bb7-8880-6a99699b3bf0 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:21.241196 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-a961ac1c-a7ab-4bb7-8880-6a99699b3bf0 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1231 microversion: 2.1 time: 0.097265 Sep 02 17:15:21.241706 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 580/1088] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:15:21 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1231 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:15:21.851217 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-f4f7c031-701f-47a1-a0d6-10825e738f4f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:21.851843 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-f4f7c031-701f-47a1-a0d6-10825e738f4f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:21.857865 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f4f7c031-701f-47a1-a0d6-10825e738f4f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:21.858385 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f4f7c031-701f-47a1-a0d6-10825e738f4f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:21.859249 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f4f7c031-701f-47a1-a0d6-10825e738f4f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:21.859756 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f4f7c031-701f-47a1-a0d6-10825e738f4f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:21.988807 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-f4f7c031-701f-47a1-a0d6-10825e738f4f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:21.997058 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-f4f7c031-701f-47a1-a0d6-10825e738f4f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:21.998525 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-f4f7c031-701f-47a1-a0d6-10825e738f4f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:21.999697 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-f4f7c031-701f-47a1-a0d6-10825e738f4f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1731 microversion: 2.20 time: 0.152251 Sep 02 17:15:22.000234 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 581/1089] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:15:21 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:15:22.258095 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-c97858f0-3f6c-40cb-82a6-8246dfce33ac tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:22.258784 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-c97858f0-3f6c-40cb-82a6-8246dfce33ac tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:22.265144 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c97858f0-3f6c-40cb-82a6-8246dfce33ac tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:22.265594 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c97858f0-3f6c-40cb-82a6-8246dfce33ac tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:22.266362 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c97858f0-3f6c-40cb-82a6-8246dfce33ac tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:22.266819 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c97858f0-3f6c-40cb-82a6-8246dfce33ac tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:22.296307 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c97858f0-3f6c-40cb-82a6-8246dfce33ac tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:22.296752 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c97858f0-3f6c-40cb-82a6-8246dfce33ac tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:22.297201 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.objects.instance [None req-c97858f0-3f6c-40cb-82a6-8246dfce33ac tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lazy-loading 'fault' on Instance uuid 34e36f29-2bc8-4586-8de2-3a218984c046 {{(pid=108418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 17:15:22.346076 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-c97858f0-3f6c-40cb-82a6-8246dfce33ac tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:22.354481 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-c97858f0-3f6c-40cb-82a6-8246dfce33ac tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 200 len: 1231 microversion: 2.1 time: 0.099960 Sep 02 17:15:22.355193 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 582/1090] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:15:22 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 1231 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:15:23.017724 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-0517d209-bf57-4e6b-ba36-17d3a638a69f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:23.018320 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-0517d209-bf57-4e6b-ba36-17d3a638a69f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:23.024062 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-0517d209-bf57-4e6b-ba36-17d3a638a69f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:23.024504 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-0517d209-bf57-4e6b-ba36-17d3a638a69f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:23.025275 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-0517d209-bf57-4e6b-ba36-17d3a638a69f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:23.025700 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-0517d209-bf57-4e6b-ba36-17d3a638a69f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:23.064772 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-c20893c2-89a4-4804-b696-2ac32e438c9e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 9.655940 Sep 02 17:15:23.065471 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 509/1091] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:15:13 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 9657 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:15:23.147109 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-0517d209-bf57-4e6b-ba36-17d3a638a69f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:23.154788 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-0517d209-bf57-4e6b-ba36-17d3a638a69f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:23.156307 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-0517d209-bf57-4e6b-ba36-17d3a638a69f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:23.157481 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-0517d209-bf57-4e6b-ba36-17d3a638a69f tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1731 microversion: 2.20 time: 0.143481 Sep 02 17:15:23.158211 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 583/1092] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:15:23 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1731 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 02 17:15:23.372664 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-4a42fd09-c293-4c14-a627-206d3e5ae37e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:23.373358 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-4a42fd09-c293-4c14-a627-206d3e5ae37e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:23.379764 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4a42fd09-c293-4c14-a627-206d3e5ae37e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:23.380213 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4a42fd09-c293-4c14-a627-206d3e5ae37e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:23.380967 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4a42fd09-c293-4c14-a627-206d3e5ae37e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:23.381395 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4a42fd09-c293-4c14-a627-206d3e5ae37e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:23.394326 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.wsgi [None req-4a42fd09-c293-4c14-a627-206d3e5ae37e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] HTTP exception thrown: Instance 34e36f29-2bc8-4586-8de2-3a218984c046 could not be found. Sep 02 17:15:23.395048 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-4a42fd09-c293-4c14-a627-206d3e5ae37e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Returning 404 to user: Instance 34e36f29-2bc8-4586-8de2-3a218984c046 could not be found. {{(pid=108417) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:15:23.395849 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-4a42fd09-c293-4c14-a627-206d3e5ae37e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 404 len: 111 microversion: 2.1 time: 0.027915 Sep 02 17:15:23.396352 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 510/1093] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:15:23 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 17:15:23.485419 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-b17052f4-5d9f-48b0-b253-79ef73864790 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2030938420", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1934407481", "security_groups": [{"name": "tempest-secgroup-smoke-1772581189"}], "block_device_mapping_v2": [{"uuid": "3ad1903e-3c01-4285-bf7e-676469694fc1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ade5891d-380a-4e81-9169-bebc402fc3c9"}]}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:15:23.584181 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.network.neutron [None req-b17052f4-5d9f-48b0-b253-79ef73864790 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] validate_networks() for [('ade5891d-380a-4e81-9169-bebc402fc3c9', None, None, None, None, None)] {{(pid=108418) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 17:15:23.940796 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-b17052f4-5d9f-48b0-b253-79ef73864790 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Flavor limits 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 17:15:23.941167 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-b17052f4-5d9f-48b0-b253-79ef73864790 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Image limits 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 17:15:23.941639 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-b17052f4-5d9f-48b0-b253-79ef73864790 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Flavor pref 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 17:15:23.942049 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-b17052f4-5d9f-48b0-b253-79ef73864790 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Image pref 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 17:15:23.942460 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-b17052f4-5d9f-48b0-b253-79ef73864790 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 17:15:23.951689 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b17052f4-5d9f-48b0-b253-79ef73864790 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:23.952137 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b17052f4-5d9f-48b0-b253-79ef73864790 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:23.952933 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b17052f4-5d9f-48b0-b253-79ef73864790 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:23.953370 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b17052f4-5d9f-48b0-b253-79ef73864790 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:23.969041 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.quota [None req-b17052f4-5d9f-48b0-b253-79ef73864790 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Getting quotas for project dc090408372e41379709e2067823b1a6. Resources: {'instances', 'cores', 'ram'} {{(pid=108418) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 17:15:23.972939 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.quota [None req-b17052f4-5d9f-48b0-b253-79ef73864790 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Getting quotas for user 6df6e202f8b64bb0b33226402b65adaf and project dc090408372e41379709e2067823b1a6. Resources: {'instances', 'cores', 'ram'} {{(pid=108418) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 17:15:24.031423 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-b17052f4-5d9f-48b0-b253-79ef73864790 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Going to run 1 instances... {{(pid=108418) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 17:15:24.033528 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-b17052f4-5d9f-48b0-b253-79ef73864790 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 3bd37709-df01-425f-bfd6-a30193970df2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3ad1903e-3c01-4285-bf7e-676469694fc1',volume_size=None,volume_type=None)] {{(pid=108418) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 17:15:24.076155 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-38baf6fd-3ac5-49c8-aaf2-cd7c056b8bd2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:15:24.077320 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-38baf6fd-3ac5-49c8-aaf2-cd7c056b8bd2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:24.083105 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-38baf6fd-3ac5-49c8-aaf2-cd7c056b8bd2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:24.083552 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-38baf6fd-3ac5-49c8-aaf2-cd7c056b8bd2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:24.084342 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-38baf6fd-3ac5-49c8-aaf2-cd7c056b8bd2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:24.084804 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-38baf6fd-3ac5-49c8-aaf2-cd7c056b8bd2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:24.156081 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-b17052f4-5d9f-48b0-b253-79ef73864790 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.674187 Sep 02 17:15:24.156703 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 584/1094] 10.222.0.41 () {60 vars in 1147 bytes} [Thu Sep 2 17:15:23 2021] POST /compute/v2.1/servers => generated 406 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 17:15:24.165844 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-bafc0894-7b50-4f5f-be6d-aa6180daa827 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:24.166443 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-bafc0894-7b50-4f5f-be6d-aa6180daa827 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 3bd37709-df01-425f-bfd6-a30193970df2] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:24.184050 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-38baf6fd-3ac5-49c8-aaf2-cd7c056b8bd2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.111471 Sep 02 17:15:24.185798 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 511/1095] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:15:24 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:15:24.194373 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-e037504b-5897-4ddf-98b1-39029c59c884 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:24.195023 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-e037504b-5897-4ddf-98b1-39029c59c884 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:24.201093 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e037504b-5897-4ddf-98b1-39029c59c884 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:24.201535 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e037504b-5897-4ddf-98b1-39029c59c884 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:24.202293 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e037504b-5897-4ddf-98b1-39029c59c884 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:24.202756 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e037504b-5897-4ddf-98b1-39029c59c884 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:24.218033 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-bafc0894-7b50-4f5f-be6d-aa6180daa827 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:24.225786 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-bafc0894-7b50-4f5f-be6d-aa6180daa827 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2" status: 200 len: 1095 microversion: 2.1 time: 0.062633 Sep 02 17:15:24.225786 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 585/1096] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:15:24 2021] GET /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2 => generated 1095 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:15:24.333812 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-e037504b-5897-4ddf-98b1-39029c59c884 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:24.342882 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-e037504b-5897-4ddf-98b1-39029c59c884 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:24.344470 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-e037504b-5897-4ddf-98b1-39029c59c884 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:24.345623 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-e037504b-5897-4ddf-98b1-39029c59c884 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1731 microversion: 2.20 time: 0.159641 Sep 02 17:15:24.346564 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 512/1097] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:15:24 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:15:25.196751 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-cd886144-7493-4fba-b558-040410908d93 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:15:25.197655 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-cd886144-7493-4fba-b558-040410908d93 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:25.204420 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cd886144-7493-4fba-b558-040410908d93 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:25.204857 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cd886144-7493-4fba-b558-040410908d93 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:25.205623 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cd886144-7493-4fba-b558-040410908d93 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:25.206055 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cd886144-7493-4fba-b558-040410908d93 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:25.244340 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-b2ee9667-2c90-4181-bcb7-7254f9ec1836 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:25.246056 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-b2ee9667-2c90-4181-bcb7-7254f9ec1836 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 3bd37709-df01-425f-bfd6-a30193970df2] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:25.252063 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b2ee9667-2c90-4181-bcb7-7254f9ec1836 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:25.253312 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b2ee9667-2c90-4181-bcb7-7254f9ec1836 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:25.254105 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b2ee9667-2c90-4181-bcb7-7254f9ec1836 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:25.254537 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b2ee9667-2c90-4181-bcb7-7254f9ec1836 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:25.307103 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-cd886144-7493-4fba-b558-040410908d93 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.109436 Sep 02 17:15:25.307103 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 586/1098] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:15:25 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:15:25.338473 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-b2ee9667-2c90-4181-bcb7-7254f9ec1836 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:25.338473 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-b2ee9667-2c90-4181-bcb7-7254f9ec1836 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2" status: 200 len: 1211 microversion: 2.1 time: 0.098087 Sep 02 17:15:25.338473 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 513/1099] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:15:25 2021] GET /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2 => generated 1211 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:15:25.364982 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-80573e87-77e6-4e2c-92a6-c9376a7bd086 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:25.365948 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-80573e87-77e6-4e2c-92a6-c9376a7bd086 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:25.373315 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-80573e87-77e6-4e2c-92a6-c9376a7bd086 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:25.373763 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-80573e87-77e6-4e2c-92a6-c9376a7bd086 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:25.374517 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-80573e87-77e6-4e2c-92a6-c9376a7bd086 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:25.374977 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-80573e87-77e6-4e2c-92a6-c9376a7bd086 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:25.520591 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-80573e87-77e6-4e2c-92a6-c9376a7bd086 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:25.528196 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-80573e87-77e6-4e2c-92a6-c9376a7bd086 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:25.529659 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-80573e87-77e6-4e2c-92a6-c9376a7bd086 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:25.530852 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-80573e87-77e6-4e2c-92a6-c9376a7bd086 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1731 microversion: 2.20 time: 0.170187 Sep 02 17:15:25.531666 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 587/1100] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:15:25 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:15:26.314354 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-6700d592-6852-413d-a2bf-e91ad6113a3b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:15:26.315355 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-6700d592-6852-413d-a2bf-e91ad6113a3b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:26.322023 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6700d592-6852-413d-a2bf-e91ad6113a3b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:26.322461 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6700d592-6852-413d-a2bf-e91ad6113a3b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:26.323801 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6700d592-6852-413d-a2bf-e91ad6113a3b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:26.324229 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6700d592-6852-413d-a2bf-e91ad6113a3b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:26.357180 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-f6d14ff6-3d07-4f02-86fa-ddc2c56cfada tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:26.358219 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-f6d14ff6-3d07-4f02-86fa-ddc2c56cfada tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 3bd37709-df01-425f-bfd6-a30193970df2] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:26.364181 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f6d14ff6-3d07-4f02-86fa-ddc2c56cfada tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:26.364637 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f6d14ff6-3d07-4f02-86fa-ddc2c56cfada tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:26.365677 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f6d14ff6-3d07-4f02-86fa-ddc2c56cfada tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:26.366115 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f6d14ff6-3d07-4f02-86fa-ddc2c56cfada tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:26.412673 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-6700d592-6852-413d-a2bf-e91ad6113a3b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.101891 Sep 02 17:15:26.413309 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 514/1101] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:15:26 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:15:26.512753 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-f6d14ff6-3d07-4f02-86fa-ddc2c56cfada tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:26.521081 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-f6d14ff6-3d07-4f02-86fa-ddc2c56cfada tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2" status: 200 len: 1267 microversion: 2.1 time: 0.170655 Sep 02 17:15:26.522081 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 588/1102] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:15:26 2021] GET /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:15:26.549681 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-8ee53315-0004-42fd-a520-2b9cec850107 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:26.550387 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-8ee53315-0004-42fd-a520-2b9cec850107 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:26.556986 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8ee53315-0004-42fd-a520-2b9cec850107 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:26.558391 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8ee53315-0004-42fd-a520-2b9cec850107 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:26.559415 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8ee53315-0004-42fd-a520-2b9cec850107 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:26.559852 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8ee53315-0004-42fd-a520-2b9cec850107 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:26.743592 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-eaa9f447-1871-4832-acf5-b29212effc85 req-b3f90321-9c85-4f9f-b3a3-1cfc7201ad91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bd37709-df01-425f-bfd6-a30193970df2", "tag": "9ca48daf-e148-4df6-9dd9-8d23ea21195e"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:15:26.747090 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:15:26.747090 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:15:26.754914 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-eaa9f447-1871-4832-acf5-b29212effc85 req-b3f90321-9c85-4f9f-b3a3-1cfc7201ad91 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:26.755658 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-eaa9f447-1871-4832-acf5-b29212effc85 req-b3f90321-9c85-4f9f-b3a3-1cfc7201ad91 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:26.769886 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-eaa9f447-1871-4832-acf5-b29212effc85 req-b3f90321-9c85-4f9f-b3a3-1cfc7201ad91 service nova] Creating event network-changed:9ca48daf-e148-4df6-9dd9-8d23ea21195e for instance 3bd37709-df01-425f-bfd6-a30193970df2 on hv-cinder-80626 Sep 02 17:15:26.773608 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-8ee53315-0004-42fd-a520-2b9cec850107 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:26.780200 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-eaa9f447-1871-4832-acf5-b29212effc85 req-b3f90321-9c85-4f9f-b3a3-1cfc7201ad91 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041623 Sep 02 17:15:26.781126 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 589/1103] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:15:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:15:26.788340 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-8ee53315-0004-42fd-a520-2b9cec850107 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:26.789952 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-8ee53315-0004-42fd-a520-2b9cec850107 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:26.791219 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-8ee53315-0004-42fd-a520-2b9cec850107 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1731 microversion: 2.20 time: 0.245926 Sep 02 17:15:26.792420 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 515/1104] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:15:26 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1731 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:15:27.425332 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-0bdb0552-38fb-4eb6-b102-d11f4075058a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:15:27.426372 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-0bdb0552-38fb-4eb6-b102-d11f4075058a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:27.433307 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-0bdb0552-38fb-4eb6-b102-d11f4075058a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:27.433755 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-0bdb0552-38fb-4eb6-b102-d11f4075058a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:27.434513 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-0bdb0552-38fb-4eb6-b102-d11f4075058a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:27.434970 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-0bdb0552-38fb-4eb6-b102-d11f4075058a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:27.537629 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-fd4a926d-3aa7-413e-b211-efb2dae4f4de tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:27.538241 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-fd4a926d-3aa7-413e-b211-efb2dae4f4de tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 3bd37709-df01-425f-bfd6-a30193970df2] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:27.544116 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fd4a926d-3aa7-413e-b211-efb2dae4f4de tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:27.544566 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fd4a926d-3aa7-413e-b211-efb2dae4f4de tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:27.545336 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fd4a926d-3aa7-413e-b211-efb2dae4f4de tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:27.545773 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fd4a926d-3aa7-413e-b211-efb2dae4f4de tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:27.678743 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-0bdb0552-38fb-4eb6-b102-d11f4075058a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.257194 Sep 02 17:15:27.683352 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 590/1105] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:15:27 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:15:27.690682 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-fd4a926d-3aa7-413e-b211-efb2dae4f4de tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:27.698078 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-fd4a926d-3aa7-413e-b211-efb2dae4f4de tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2" status: 200 len: 1267 microversion: 2.1 time: 0.163970 Sep 02 17:15:27.699300 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 516/1106] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:15:27 2021] GET /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:15:27.811416 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-0cb0bdbd-e153-4842-93d3-a0f8993038d8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:27.812111 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-0cb0bdbd-e153-4842-93d3-a0f8993038d8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:27.818505 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-0cb0bdbd-e153-4842-93d3-a0f8993038d8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:27.818988 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-0cb0bdbd-e153-4842-93d3-a0f8993038d8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:27.819750 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-0cb0bdbd-e153-4842-93d3-a0f8993038d8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:27.820182 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-0cb0bdbd-e153-4842-93d3-a0f8993038d8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:27.940122 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-0cb0bdbd-e153-4842-93d3-a0f8993038d8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:27.947804 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-0cb0bdbd-e153-4842-93d3-a0f8993038d8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:27.949311 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-0cb0bdbd-e153-4842-93d3-a0f8993038d8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:27.950454 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-0cb0bdbd-e153-4842-93d3-a0f8993038d8 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1731 microversion: 2.20 time: 0.143890 Sep 02 17:15:27.951051 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 591/1107] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:15:27 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1731 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:15:28.067279 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [req-85cc811e-458d-4646-832f-7c72672f304c req-ed6dcd1e-b628-4774-a475-3551b5230231 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41c895d8-bf14-4b23-8657-02bf702bb50c", "name": "network-vif-plugged", "status": "completed", "tag": "88ce9e99-9c0c-4984-9fbe-83639825e7cc"}]} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:15:28.071464 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:15:28.071464 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: warnings.warn(msg) Sep 02 17:15:28.078427 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-85cc811e-458d-4646-832f-7c72672f304c req-ed6dcd1e-b628-4774-a475-3551b5230231 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:28.078922 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-85cc811e-458d-4646-832f-7c72672f304c req-ed6dcd1e-b628-4774-a475-3551b5230231 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:28.091434 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.compute.server_external_events [req-85cc811e-458d-4646-832f-7c72672f304c req-ed6dcd1e-b628-4774-a475-3551b5230231 service nova] Creating event network-vif-plugged:88ce9e99-9c0c-4984-9fbe-83639825e7cc for instance 41c895d8-bf14-4b23-8657-02bf702bb50c on hv-cinder-80626 Sep 02 17:15:28.096238 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [req-85cc811e-458d-4646-832f-7c72672f304c req-ed6dcd1e-b628-4774-a475-3551b5230231 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032597 Sep 02 17:15:28.096817 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 517/1108] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:15:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:15:28.690939 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-4e30a692-f336-499b-8e95-2e997c9bd030 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:15:28.691864 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-4e30a692-f336-499b-8e95-2e997c9bd030 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:28.697686 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4e30a692-f336-499b-8e95-2e997c9bd030 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:28.698132 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4e30a692-f336-499b-8e95-2e997c9bd030 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:28.698917 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4e30a692-f336-499b-8e95-2e997c9bd030 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:28.699351 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4e30a692-f336-499b-8e95-2e997c9bd030 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:28.716057 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-cb860ca9-b017-46ef-99f7-44a87bbd83d6 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:28.716876 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-cb860ca9-b017-46ef-99f7-44a87bbd83d6 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 3bd37709-df01-425f-bfd6-a30193970df2] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:28.722844 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-cb860ca9-b017-46ef-99f7-44a87bbd83d6 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:28.723293 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-cb860ca9-b017-46ef-99f7-44a87bbd83d6 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:28.724099 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-cb860ca9-b017-46ef-99f7-44a87bbd83d6 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:28.724534 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-cb860ca9-b017-46ef-99f7-44a87bbd83d6 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:28.819234 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-4e30a692-f336-499b-8e95-2e997c9bd030 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.131766 Sep 02 17:15:28.820786 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 592/1109] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:15:28 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:15:28.845948 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-cb860ca9-b017-46ef-99f7-44a87bbd83d6 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:28.853178 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-cb860ca9-b017-46ef-99f7-44a87bbd83d6 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2" status: 200 len: 1267 microversion: 2.1 time: 0.141122 Sep 02 17:15:28.853754 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 518/1110] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:15:28 2021] GET /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2 => generated 1267 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:15:28.969112 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-f92a0dbd-9552-4cf6-a264-58cf451f170e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:28.969810 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-f92a0dbd-9552-4cf6-a264-58cf451f170e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:28.976251 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f92a0dbd-9552-4cf6-a264-58cf451f170e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:28.976702 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f92a0dbd-9552-4cf6-a264-58cf451f170e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:28.977467 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f92a0dbd-9552-4cf6-a264-58cf451f170e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:28.977904 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f92a0dbd-9552-4cf6-a264-58cf451f170e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:29.099440 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-f92a0dbd-9552-4cf6-a264-58cf451f170e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:29.107643 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-f92a0dbd-9552-4cf6-a264-58cf451f170e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:29.109129 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-f92a0dbd-9552-4cf6-a264-58cf451f170e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:29.110269 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-f92a0dbd-9552-4cf6-a264-58cf451f170e tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1731 microversion: 2.20 time: 0.145210 Sep 02 17:15:29.110845 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 593/1111] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:15:28 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1731 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:15:29.831234 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-432b6af7-dd75-48eb-bc16-22843f021361 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:15:29.832505 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-432b6af7-dd75-48eb-bc16-22843f021361 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:29.839607 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-432b6af7-dd75-48eb-bc16-22843f021361 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:29.840154 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-432b6af7-dd75-48eb-bc16-22843f021361 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:29.841014 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-432b6af7-dd75-48eb-bc16-22843f021361 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:29.841450 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-432b6af7-dd75-48eb-bc16-22843f021361 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:29.870651 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-9ac8b96f-1156-435e-a014-2faa8cb725a9 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:29.871244 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-9ac8b96f-1156-435e-a014-2faa8cb725a9 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 3bd37709-df01-425f-bfd6-a30193970df2] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:29.877453 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9ac8b96f-1156-435e-a014-2faa8cb725a9 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:29.877902 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9ac8b96f-1156-435e-a014-2faa8cb725a9 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:29.878672 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9ac8b96f-1156-435e-a014-2faa8cb725a9 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:29.879101 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9ac8b96f-1156-435e-a014-2faa8cb725a9 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:29.927620 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-432b6af7-dd75-48eb-bc16-22843f021361 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.099743 Sep 02 17:15:29.929241 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 519/1112] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:15:29 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:15:30.001087 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-9ac8b96f-1156-435e-a014-2faa8cb725a9 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:30.008977 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-9ac8b96f-1156-435e-a014-2faa8cb725a9 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2" status: 200 len: 1267 microversion: 2.1 time: 0.142207 Sep 02 17:15:30.009513 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 594/1113] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:15:29 2021] GET /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2 => generated 1267 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:15:30.129025 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-73a4bc1c-ea1c-493a-9a54-d7a94a107c46 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:30.129807 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-73a4bc1c-ea1c-493a-9a54-d7a94a107c46 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:30.137903 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-73a4bc1c-ea1c-493a-9a54-d7a94a107c46 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:30.138856 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-73a4bc1c-ea1c-493a-9a54-d7a94a107c46 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:30.139837 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-73a4bc1c-ea1c-493a-9a54-d7a94a107c46 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:30.140338 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-73a4bc1c-ea1c-493a-9a54-d7a94a107c46 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:30.268778 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-73a4bc1c-ea1c-493a-9a54-d7a94a107c46 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:30.277115 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-73a4bc1c-ea1c-493a-9a54-d7a94a107c46 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:30.278618 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-73a4bc1c-ea1c-493a-9a54-d7a94a107c46 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:30.279775 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-73a4bc1c-ea1c-493a-9a54-d7a94a107c46 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1731 microversion: 2.20 time: 0.154918 Sep 02 17:15:30.280321 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 520/1114] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:15:30 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:15:30.939576 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-bda7efdb-ac64-47c4-9cab-19dc518f3158 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:15:30.940489 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-bda7efdb-ac64-47c4-9cab-19dc518f3158 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:30.946324 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bda7efdb-ac64-47c4-9cab-19dc518f3158 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:30.946860 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bda7efdb-ac64-47c4-9cab-19dc518f3158 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:30.947629 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bda7efdb-ac64-47c4-9cab-19dc518f3158 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:30.948064 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bda7efdb-ac64-47c4-9cab-19dc518f3158 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:31.024886 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-d6f93fbf-1a23-4457-a2ef-f5c3a00e0e24 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:31.025492 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-d6f93fbf-1a23-4457-a2ef-f5c3a00e0e24 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 3bd37709-df01-425f-bfd6-a30193970df2] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:31.030786 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-bda7efdb-ac64-47c4-9cab-19dc518f3158 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.094527 Sep 02 17:15:31.031664 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 595/1115] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:15:30 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:15:31.031800 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d6f93fbf-1a23-4457-a2ef-f5c3a00e0e24 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:31.032082 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d6f93fbf-1a23-4457-a2ef-f5c3a00e0e24 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:31.032909 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d6f93fbf-1a23-4457-a2ef-f5c3a00e0e24 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:31.033344 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d6f93fbf-1a23-4457-a2ef-f5c3a00e0e24 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:31.150066 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-d6f93fbf-1a23-4457-a2ef-f5c3a00e0e24 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:31.157684 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-d6f93fbf-1a23-4457-a2ef-f5c3a00e0e24 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2" status: 200 len: 1267 microversion: 2.1 time: 0.136382 Sep 02 17:15:31.158231 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 521/1116] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:15:31 2021] GET /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2 => generated 1267 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:15:31.299006 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-7372f060-8359-4152-ae22-2d60c822d2cd tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:31.299698 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-7372f060-8359-4152-ae22-2d60c822d2cd tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:31.306215 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7372f060-8359-4152-ae22-2d60c822d2cd tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:31.306687 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7372f060-8359-4152-ae22-2d60c822d2cd tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:31.307483 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7372f060-8359-4152-ae22-2d60c822d2cd tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:31.307919 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7372f060-8359-4152-ae22-2d60c822d2cd tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:31.427298 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-7372f060-8359-4152-ae22-2d60c822d2cd tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:31.434895 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-7372f060-8359-4152-ae22-2d60c822d2cd tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:31.436362 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-7372f060-8359-4152-ae22-2d60c822d2cd tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:31.437501 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-7372f060-8359-4152-ae22-2d60c822d2cd tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1718 microversion: 2.20 time: 0.142727 Sep 02 17:15:31.438070 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 596/1117] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:15:31 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1718 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:15:32.042479 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-213cff71-ee3b-4866-b874-4adf37793177 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:15:32.043416 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-213cff71-ee3b-4866-b874-4adf37793177 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:32.049272 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-213cff71-ee3b-4866-b874-4adf37793177 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:32.049724 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-213cff71-ee3b-4866-b874-4adf37793177 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:32.050492 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-213cff71-ee3b-4866-b874-4adf37793177 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:32.050954 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-213cff71-ee3b-4866-b874-4adf37793177 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:32.140464 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-213cff71-ee3b-4866-b874-4adf37793177 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.101489 Sep 02 17:15:32.141102 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 522/1118] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:15:32 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:15:32.172861 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-addc44eb-95bf-4f32-943e-f26b9b2effea tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:32.173479 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-addc44eb-95bf-4f32-943e-f26b9b2effea tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 3bd37709-df01-425f-bfd6-a30193970df2] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:32.179323 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-addc44eb-95bf-4f32-943e-f26b9b2effea tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:32.179754 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-addc44eb-95bf-4f32-943e-f26b9b2effea tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:32.180518 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-addc44eb-95bf-4f32-943e-f26b9b2effea tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:32.180959 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-addc44eb-95bf-4f32-943e-f26b9b2effea tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:32.304580 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-addc44eb-95bf-4f32-943e-f26b9b2effea tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:32.312942 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-addc44eb-95bf-4f32-943e-f26b9b2effea tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2" status: 200 len: 1267 microversion: 2.1 time: 0.143691 Sep 02 17:15:32.313498 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 597/1119] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:15:32 2021] GET /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2 => generated 1267 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:15:33.152833 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-23c715f3-7aef-4288-afcd-fc0d25aefc36 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:15:33.153812 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-23c715f3-7aef-4288-afcd-fc0d25aefc36 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:33.160217 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-23c715f3-7aef-4288-afcd-fc0d25aefc36 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:33.160658 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-23c715f3-7aef-4288-afcd-fc0d25aefc36 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:33.161403 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-23c715f3-7aef-4288-afcd-fc0d25aefc36 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:33.161827 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-23c715f3-7aef-4288-afcd-fc0d25aefc36 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:33.245420 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-23c715f3-7aef-4288-afcd-fc0d25aefc36 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.095835 Sep 02 17:15:33.246104 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 523/1120] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:15:33 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:15:33.329195 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-6896bcb1-4cfd-4d32-976e-47c51e982754 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:33.329811 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-6896bcb1-4cfd-4d32-976e-47c51e982754 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 3bd37709-df01-425f-bfd6-a30193970df2] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:33.335690 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6896bcb1-4cfd-4d32-976e-47c51e982754 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:33.336141 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6896bcb1-4cfd-4d32-976e-47c51e982754 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:33.336907 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6896bcb1-4cfd-4d32-976e-47c51e982754 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:33.337342 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6896bcb1-4cfd-4d32-976e-47c51e982754 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:33.454926 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-6896bcb1-4cfd-4d32-976e-47c51e982754 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:33.462581 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-6896bcb1-4cfd-4d32-976e-47c51e982754 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2" status: 200 len: 1267 microversion: 2.1 time: 0.137095 Sep 02 17:15:33.463205 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 598/1121] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:15:33 2021] GET /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2 => generated 1267 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:15:34.257485 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-82d89228-7882-4336-ba6d-aafed40fea56 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:15:34.258492 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-82d89228-7882-4336-ba6d-aafed40fea56 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:34.265649 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-82d89228-7882-4336-ba6d-aafed40fea56 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:34.266095 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-82d89228-7882-4336-ba6d-aafed40fea56 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:34.266895 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-82d89228-7882-4336-ba6d-aafed40fea56 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:34.267333 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-82d89228-7882-4336-ba6d-aafed40fea56 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:34.358371 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-82d89228-7882-4336-ba6d-aafed40fea56 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.104796 Sep 02 17:15:34.359020 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 524/1122] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:15:34 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:15:34.480097 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-2a9b4d4b-5f0e-4071-a0ea-5af53e1d6594 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:34.480700 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-2a9b4d4b-5f0e-4071-a0ea-5af53e1d6594 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 3bd37709-df01-425f-bfd6-a30193970df2] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:34.487001 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2a9b4d4b-5f0e-4071-a0ea-5af53e1d6594 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:34.487394 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2a9b4d4b-5f0e-4071-a0ea-5af53e1d6594 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:34.488151 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2a9b4d4b-5f0e-4071-a0ea-5af53e1d6594 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:34.488606 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2a9b4d4b-5f0e-4071-a0ea-5af53e1d6594 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:34.605356 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-2a9b4d4b-5f0e-4071-a0ea-5af53e1d6594 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:34.612435 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-2a9b4d4b-5f0e-4071-a0ea-5af53e1d6594 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2" status: 200 len: 1267 microversion: 2.1 time: 0.136530 Sep 02 17:15:34.612983 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 599/1123] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:15:34 2021] GET /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2 => generated 1267 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:15:35.371697 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-ea38fb58-d9ff-435e-bc4f-7aa8abc2a5cf tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:15:35.372678 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-ea38fb58-d9ff-435e-bc4f-7aa8abc2a5cf tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:35.379196 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ea38fb58-d9ff-435e-bc4f-7aa8abc2a5cf tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:35.379638 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ea38fb58-d9ff-435e-bc4f-7aa8abc2a5cf tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:35.380397 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ea38fb58-d9ff-435e-bc4f-7aa8abc2a5cf tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:35.380830 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ea38fb58-d9ff-435e-bc4f-7aa8abc2a5cf tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:35.465602 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-ea38fb58-d9ff-435e-bc4f-7aa8abc2a5cf tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.098466 Sep 02 17:15:35.466553 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 525/1124] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:15:35 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:15:35.629088 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-39e7486d-1b3c-49ff-9faa-d5166e4f3198 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:35.629646 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-39e7486d-1b3c-49ff-9faa-d5166e4f3198 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 3bd37709-df01-425f-bfd6-a30193970df2] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:35.635451 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-39e7486d-1b3c-49ff-9faa-d5166e4f3198 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:35.635903 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-39e7486d-1b3c-49ff-9faa-d5166e4f3198 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:35.636662 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-39e7486d-1b3c-49ff-9faa-d5166e4f3198 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:35.637093 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-39e7486d-1b3c-49ff-9faa-d5166e4f3198 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:35.756626 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-39e7486d-1b3c-49ff-9faa-d5166e4f3198 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:35.763801 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-39e7486d-1b3c-49ff-9faa-d5166e4f3198 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2" status: 200 len: 1267 microversion: 2.1 time: 0.138516 Sep 02 17:15:35.764346 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 600/1125] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:15:35 2021] GET /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2 => generated 1267 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:15:36.477875 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-0079bc0b-0c7d-4187-9e2c-6b0e7ce68530 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:15:36.478886 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-0079bc0b-0c7d-4187-9e2c-6b0e7ce68530 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:36.485452 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0079bc0b-0c7d-4187-9e2c-6b0e7ce68530 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:36.485891 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0079bc0b-0c7d-4187-9e2c-6b0e7ce68530 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:36.486745 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0079bc0b-0c7d-4187-9e2c-6b0e7ce68530 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:36.487131 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0079bc0b-0c7d-4187-9e2c-6b0e7ce68530 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:36.580549 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-0079bc0b-0c7d-4187-9e2c-6b0e7ce68530 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.106492 Sep 02 17:15:36.581478 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 526/1126] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:15:36 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:15:36.780093 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-95c28157-060e-4c02-8326-7b9512dd4875 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:36.780649 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-95c28157-060e-4c02-8326-7b9512dd4875 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 3bd37709-df01-425f-bfd6-a30193970df2] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:36.786319 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-95c28157-060e-4c02-8326-7b9512dd4875 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:36.786795 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-95c28157-060e-4c02-8326-7b9512dd4875 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:36.787546 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-95c28157-060e-4c02-8326-7b9512dd4875 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:36.787973 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-95c28157-060e-4c02-8326-7b9512dd4875 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:36.905060 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-95c28157-060e-4c02-8326-7b9512dd4875 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:36.912099 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-95c28157-060e-4c02-8326-7b9512dd4875 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2" status: 200 len: 1267 microversion: 2.1 time: 0.135717 Sep 02 17:15:36.912648 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 601/1127] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:15:36 2021] GET /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2 => generated 1267 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:15:37.592914 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-b39957ca-7ab5-4d44-8722-74e75f7b8d3d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:15:37.593902 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-b39957ca-7ab5-4d44-8722-74e75f7b8d3d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:37.600371 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b39957ca-7ab5-4d44-8722-74e75f7b8d3d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:37.600819 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b39957ca-7ab5-4d44-8722-74e75f7b8d3d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:37.601578 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b39957ca-7ab5-4d44-8722-74e75f7b8d3d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:37.602012 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b39957ca-7ab5-4d44-8722-74e75f7b8d3d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:37.686075 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-b39957ca-7ab5-4d44-8722-74e75f7b8d3d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.097032 Sep 02 17:15:37.686971 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 527/1128] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:15:37 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:15:37.929149 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-c5cbf8b0-1a12-4173-9fc3-645fa42a5a06 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:37.929655 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-c5cbf8b0-1a12-4173-9fc3-645fa42a5a06 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 3bd37709-df01-425f-bfd6-a30193970df2] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:37.935982 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c5cbf8b0-1a12-4173-9fc3-645fa42a5a06 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:37.936428 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c5cbf8b0-1a12-4173-9fc3-645fa42a5a06 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:37.937185 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c5cbf8b0-1a12-4173-9fc3-645fa42a5a06 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:37.937616 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c5cbf8b0-1a12-4173-9fc3-645fa42a5a06 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:38.057343 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-c5cbf8b0-1a12-4173-9fc3-645fa42a5a06 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:38.065020 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-c5cbf8b0-1a12-4173-9fc3-645fa42a5a06 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2" status: 200 len: 1267 microversion: 2.1 time: 0.139570 Sep 02 17:15:38.065574 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 602/1129] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:15:37 2021] GET /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2 => generated 1267 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:15:38.125504 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [req-53719940-ad7d-4c80-afa8-154bceb12c02 req-c94151b7-15cf-416a-baa7-edae8737c0b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bd37709-df01-425f-bfd6-a30193970df2", "name": "network-vif-plugged", "status": "completed", "tag": "9ca48daf-e148-4df6-9dd9-8d23ea21195e"}]} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:15:38.126985 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:15:38.126985 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: warnings.warn(msg) Sep 02 17:15:38.135006 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-53719940-ad7d-4c80-afa8-154bceb12c02 req-c94151b7-15cf-416a-baa7-edae8737c0b3 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:38.135441 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-53719940-ad7d-4c80-afa8-154bceb12c02 req-c94151b7-15cf-416a-baa7-edae8737c0b3 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:38.147581 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.compute.server_external_events [req-53719940-ad7d-4c80-afa8-154bceb12c02 req-c94151b7-15cf-416a-baa7-edae8737c0b3 service nova] Creating event network-vif-plugged:9ca48daf-e148-4df6-9dd9-8d23ea21195e for instance 3bd37709-df01-425f-bfd6-a30193970df2 on hv-cinder-80626 Sep 02 17:15:38.152247 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [req-53719940-ad7d-4c80-afa8-154bceb12c02 req-c94151b7-15cf-416a-baa7-edae8737c0b3 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033357 Sep 02 17:15:38.153136 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 528/1130] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:15:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:15:38.697638 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-256aab83-d2d0-49c3-9fe8-ec90d880e2fe tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:15:38.698465 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-256aab83-d2d0-49c3-9fe8-ec90d880e2fe tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:38.704668 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-256aab83-d2d0-49c3-9fe8-ec90d880e2fe tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:38.705112 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-256aab83-d2d0-49c3-9fe8-ec90d880e2fe tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:38.705870 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-256aab83-d2d0-49c3-9fe8-ec90d880e2fe tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:38.706302 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-256aab83-d2d0-49c3-9fe8-ec90d880e2fe tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:38.793522 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-256aab83-d2d0-49c3-9fe8-ec90d880e2fe tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.098954 Sep 02 17:15:38.794396 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 603/1131] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:15:38 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:15:39.082792 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-a36c7d0c-55d7-4c19-a39a-ccbebbd8f458 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:39.083500 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-a36c7d0c-55d7-4c19-a39a-ccbebbd8f458 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 3bd37709-df01-425f-bfd6-a30193970df2] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:39.090156 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a36c7d0c-55d7-4c19-a39a-ccbebbd8f458 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:39.090606 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a36c7d0c-55d7-4c19-a39a-ccbebbd8f458 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:39.091390 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a36c7d0c-55d7-4c19-a39a-ccbebbd8f458 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:39.091825 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a36c7d0c-55d7-4c19-a39a-ccbebbd8f458 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:39.208164 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-a36c7d0c-55d7-4c19-a39a-ccbebbd8f458 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:39.215394 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-a36c7d0c-55d7-4c19-a39a-ccbebbd8f458 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2" status: 200 len: 1267 microversion: 2.1 time: 0.136620 Sep 02 17:15:39.215949 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 529/1132] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:15:39 2021] GET /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2 => generated 1267 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:15:39.805919 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-c6ee0346-d0bd-400f-8d17-5910571af4c0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:15:39.806968 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-c6ee0346-d0bd-400f-8d17-5910571af4c0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:39.813368 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c6ee0346-d0bd-400f-8d17-5910571af4c0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:39.813803 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c6ee0346-d0bd-400f-8d17-5910571af4c0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:39.814554 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c6ee0346-d0bd-400f-8d17-5910571af4c0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:39.815009 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c6ee0346-d0bd-400f-8d17-5910571af4c0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:39.899067 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-c6ee0346-d0bd-400f-8d17-5910571af4c0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.096966 Sep 02 17:15:39.899700 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 604/1133] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:15:39 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:15:40.232088 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-088c1d46-6002-48ad-b99a-c2ed2b55b06f tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:40.232608 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-088c1d46-6002-48ad-b99a-c2ed2b55b06f tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 3bd37709-df01-425f-bfd6-a30193970df2] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:40.238451 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-088c1d46-6002-48ad-b99a-c2ed2b55b06f tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:40.238929 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-088c1d46-6002-48ad-b99a-c2ed2b55b06f tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:40.239696 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-088c1d46-6002-48ad-b99a-c2ed2b55b06f tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:40.240129 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-088c1d46-6002-48ad-b99a-c2ed2b55b06f tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:40.357049 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-088c1d46-6002-48ad-b99a-c2ed2b55b06f tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:40.364219 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-088c1d46-6002-48ad-b99a-c2ed2b55b06f tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2" status: 200 len: 1452 microversion: 2.1 time: 0.135968 Sep 02 17:15:40.364767 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 530/1134] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:15:40 2021] GET /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2 => generated 1452 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:15:40.381417 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-3e321307-5b92-478e-b92e-a55b393ea5a4 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:40.382114 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-3e321307-5b92-478e-b92e-a55b393ea5a4 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 3bd37709-df01-425f-bfd6-a30193970df2] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:40.389052 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3e321307-5b92-478e-b92e-a55b393ea5a4 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:40.389497 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3e321307-5b92-478e-b92e-a55b393ea5a4 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:40.390257 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3e321307-5b92-478e-b92e-a55b393ea5a4 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:40.390720 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3e321307-5b92-478e-b92e-a55b393ea5a4 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:40.514050 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-3e321307-5b92-478e-b92e-a55b393ea5a4 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:40.521379 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-3e321307-5b92-478e-b92e-a55b393ea5a4 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2" status: 200 len: 1452 microversion: 2.1 time: 0.144006 Sep 02 17:15:40.521933 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 605/1135] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:15:40 2021] GET /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2 => generated 1452 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:15:40.911405 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-61e38abd-6427-4b30-b4c7-9d4de99fa805 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:15:40.912313 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-61e38abd-6427-4b30-b4c7-9d4de99fa805 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:40.918845 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-61e38abd-6427-4b30-b4c7-9d4de99fa805 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:40.919286 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-61e38abd-6427-4b30-b4c7-9d4de99fa805 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:40.920049 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-61e38abd-6427-4b30-b4c7-9d4de99fa805 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:40.920477 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-61e38abd-6427-4b30-b4c7-9d4de99fa805 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:41.007075 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-61e38abd-6427-4b30-b4c7-9d4de99fa805 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 200 len: 41470 microversion: 2.1 time: 0.099120 Sep 02 17:15:41.012753 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 531/1136] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:15:40 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 41470 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:15:41.017794 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-e6d01535-2299-4f4d-9e7f-8a6476453915 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:41.018280 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-e6d01535-2299-4f4d-9e7f-8a6476453915 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:41.023947 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e6d01535-2299-4f4d-9e7f-8a6476453915 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:41.024382 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e6d01535-2299-4f4d-9e7f-8a6476453915 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:41.025141 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e6d01535-2299-4f4d-9e7f-8a6476453915 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:41.025570 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e6d01535-2299-4f4d-9e7f-8a6476453915 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:41.049634 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-e6d01535-2299-4f4d-9e7f-8a6476453915 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/ips" status: 200 len: 145 microversion: 2.1 time: 0.035501 Sep 02 17:15:41.050193 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 606/1137] 10.222.0.41 () {58 vars in 1248 bytes} [Thu Sep 2 17:15:41 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/ips => generated 145 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:15:42.108711 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [req-4e760367-a127-4c24-8967-ad05a99b8e68 req-9f06c248-5684-4f33-b932-55d9765e51aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bd37709-df01-425f-bfd6-a30193970df2", "tag": "9ca48daf-e148-4df6-9dd9-8d23ea21195e"}]} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:15:42.111104 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:15:42.111104 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: warnings.warn(msg) Sep 02 17:15:42.119638 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-4e760367-a127-4c24-8967-ad05a99b8e68 req-9f06c248-5684-4f33-b932-55d9765e51aa service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:42.120064 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-4e760367-a127-4c24-8967-ad05a99b8e68 req-9f06c248-5684-4f33-b932-55d9765e51aa service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:42.132276 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.compute.server_external_events [req-4e760367-a127-4c24-8967-ad05a99b8e68 req-9f06c248-5684-4f33-b932-55d9765e51aa service nova] Creating event network-changed:9ca48daf-e148-4df6-9dd9-8d23ea21195e for instance 3bd37709-df01-425f-bfd6-a30193970df2 on hv-cinder-80626 Sep 02 17:15:42.137786 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [req-4e760367-a127-4c24-8967-ad05a99b8e68 req-9f06c248-5684-4f33-b932-55d9765e51aa service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035495 Sep 02 17:15:42.139099 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 532/1138] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:15:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:15:43.276401 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-014f64e2-26df-41a9-a72e-eb01ac2de66c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10273fcb-080d-4a74-8b33-f2a8bb4fe202"}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:15:43.277528 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-014f64e2-26df-41a9-a72e-eb01ac2de66c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:43.283832 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-014f64e2-26df-41a9-a72e-eb01ac2de66c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:43.284278 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-014f64e2-26df-41a9-a72e-eb01ac2de66c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:43.285032 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-014f64e2-26df-41a9-a72e-eb01ac2de66c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:43.285463 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-014f64e2-26df-41a9-a72e-eb01ac2de66c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:43.523884 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-014f64e2-26df-41a9-a72e-eb01ac2de66c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251144 Sep 02 17:15:43.524488 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 607/1139] 10.222.0.41 () {60 vars in 1323 bytes} [Thu Sep 2 17:15:43 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/os-volume_attachments => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:15:51.028230 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-32a6e3c1-53bf-48e9-9f56-d94931fdaeec tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:15:51.034153 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-32a6e3c1-53bf-48e9-9f56-d94931fdaeec tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:51.034590 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-32a6e3c1-53bf-48e9-9f56-d94931fdaeec tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:51.092564 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-32a6e3c1-53bf-48e9-9f56-d94931fdaeec tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Going to try to stop instance {{(pid=108417) force_stop /opt/stack/nova/nova/compute/api.py:2651}} Sep 02 17:15:51.131974 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-32a6e3c1-53bf-48e9-9f56-d94931fdaeec tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 202 len: 0 microversion: 2.1 time: 0.108577 Sep 02 17:15:51.132551 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 533/1140] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:15:51 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:15:51.142368 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-2f14e4cd-b900-4a12-9794-c996c46abe94 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:51.143108 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-2f14e4cd-b900-4a12-9794-c996c46abe94 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:51.150051 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2f14e4cd-b900-4a12-9794-c996c46abe94 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:51.150503 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2f14e4cd-b900-4a12-9794-c996c46abe94 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:51.153157 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2f14e4cd-b900-4a12-9794-c996c46abe94 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:51.153608 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2f14e4cd-b900-4a12-9794-c996c46abe94 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:51.275636 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-2f14e4cd-b900-4a12-9794-c996c46abe94 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:51.283896 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-2f14e4cd-b900-4a12-9794-c996c46abe94 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1723 microversion: 2.1 time: 0.145841 Sep 02 17:15:51.284445 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 608/1141] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:15:51 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:15:52.302263 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-3905ccd3-36c9-4829-bb5c-fbfc86fc8dea tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:52.303037 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-3905ccd3-36c9-4829-bb5c-fbfc86fc8dea tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:52.309295 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3905ccd3-36c9-4829-bb5c-fbfc86fc8dea tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:52.309763 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3905ccd3-36c9-4829-bb5c-fbfc86fc8dea tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:52.310542 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3905ccd3-36c9-4829-bb5c-fbfc86fc8dea tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:52.311042 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3905ccd3-36c9-4829-bb5c-fbfc86fc8dea tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:52.429624 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-3905ccd3-36c9-4829-bb5c-fbfc86fc8dea tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:52.441319 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-3905ccd3-36c9-4829-bb5c-fbfc86fc8dea tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1723 microversion: 2.1 time: 0.143830 Sep 02 17:15:52.441882 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 534/1142] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:15:52 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1723 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:15:53.458610 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-2fc0e501-3d5e-4db3-9543-cd624594f9a6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:53.459237 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-2fc0e501-3d5e-4db3-9543-cd624594f9a6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:53.465451 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2fc0e501-3d5e-4db3-9543-cd624594f9a6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:53.466506 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2fc0e501-3d5e-4db3-9543-cd624594f9a6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:53.467283 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2fc0e501-3d5e-4db3-9543-cd624594f9a6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:53.467712 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2fc0e501-3d5e-4db3-9543-cd624594f9a6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:53.583937 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-2fc0e501-3d5e-4db3-9543-cd624594f9a6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:53.591508 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-2fc0e501-3d5e-4db3-9543-cd624594f9a6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1723 microversion: 2.1 time: 0.136611 Sep 02 17:15:53.592068 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 609/1143] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:15:53 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1723 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:15:54.608196 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-929a008f-9edc-4bec-b70b-3f1b29b19ce7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:54.608808 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-929a008f-9edc-4bec-b70b-3f1b29b19ce7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:54.615069 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-929a008f-9edc-4bec-b70b-3f1b29b19ce7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:54.615522 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-929a008f-9edc-4bec-b70b-3f1b29b19ce7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:54.616537 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-929a008f-9edc-4bec-b70b-3f1b29b19ce7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:54.616971 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-929a008f-9edc-4bec-b70b-3f1b29b19ce7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:54.737671 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-929a008f-9edc-4bec-b70b-3f1b29b19ce7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:54.745634 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-929a008f-9edc-4bec-b70b-3f1b29b19ce7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1723 microversion: 2.1 time: 0.141773 Sep 02 17:15:54.746189 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 535/1144] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:15:54 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1723 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:15:55.762738 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-fa50db83-b09a-4376-94dd-717e90a51754 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:55.763396 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-fa50db83-b09a-4376-94dd-717e90a51754 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:55.769181 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fa50db83-b09a-4376-94dd-717e90a51754 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:55.769615 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fa50db83-b09a-4376-94dd-717e90a51754 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:55.770369 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fa50db83-b09a-4376-94dd-717e90a51754 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:55.770823 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fa50db83-b09a-4376-94dd-717e90a51754 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:55.892395 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-fa50db83-b09a-4376-94dd-717e90a51754 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:55.899981 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-fa50db83-b09a-4376-94dd-717e90a51754 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1723 microversion: 2.1 time: 0.140896 Sep 02 17:15:55.900531 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 610/1145] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:15:55 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1723 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:15:56.917545 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-38689ea2-97ec-4a2f-8978-78cef1551c5d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:56.918144 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-38689ea2-97ec-4a2f-8978-78cef1551c5d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:56.924446 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-38689ea2-97ec-4a2f-8978-78cef1551c5d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:56.924884 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-38689ea2-97ec-4a2f-8978-78cef1551c5d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:56.925631 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-38689ea2-97ec-4a2f-8978-78cef1551c5d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:56.926059 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-38689ea2-97ec-4a2f-8978-78cef1551c5d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:57.041455 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-38689ea2-97ec-4a2f-8978-78cef1551c5d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:57.049514 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-38689ea2-97ec-4a2f-8978-78cef1551c5d tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1723 microversion: 2.1 time: 0.136301 Sep 02 17:15:57.050067 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 536/1146] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:15:56 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1723 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:15:58.066576 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-cbfe7437-2d18-4808-8181-f51023429f96 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:58.067225 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-cbfe7437-2d18-4808-8181-f51023429f96 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:58.073385 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cbfe7437-2d18-4808-8181-f51023429f96 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:58.073842 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cbfe7437-2d18-4808-8181-f51023429f96 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:58.074573 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cbfe7437-2d18-4808-8181-f51023429f96 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:58.075026 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-cbfe7437-2d18-4808-8181-f51023429f96 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:58.199013 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-cbfe7437-2d18-4808-8181-f51023429f96 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:58.207287 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-cbfe7437-2d18-4808-8181-f51023429f96 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1723 microversion: 2.1 time: 0.144369 Sep 02 17:15:58.207841 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 611/1147] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:15:58 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:15:59.223819 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-22f34031-0cc5-4d6d-a9db-cf2dc9ac5680 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:15:59.224458 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-22f34031-0cc5-4d6d-a9db-cf2dc9ac5680 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:15:59.230740 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-22f34031-0cc5-4d6d-a9db-cf2dc9ac5680 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:59.231185 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-22f34031-0cc5-4d6d-a9db-cf2dc9ac5680 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:59.231971 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-22f34031-0cc5-4d6d-a9db-cf2dc9ac5680 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:15:59.232399 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-22f34031-0cc5-4d6d-a9db-cf2dc9ac5680 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:15:59.348437 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-22f34031-0cc5-4d6d-a9db-cf2dc9ac5680 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:15:59.356209 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-22f34031-0cc5-4d6d-a9db-cf2dc9ac5680 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1723 microversion: 2.1 time: 0.136027 Sep 02 17:15:59.356828 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 537/1148] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:15:59 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1723 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:00.372940 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-d58e7f83-7f3b-4a8d-941e-33f8d74e3810 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:00.373583 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-d58e7f83-7f3b-4a8d-941e-33f8d74e3810 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:00.379490 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d58e7f83-7f3b-4a8d-941e-33f8d74e3810 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:00.379939 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d58e7f83-7f3b-4a8d-941e-33f8d74e3810 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:00.380722 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d58e7f83-7f3b-4a8d-941e-33f8d74e3810 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:00.381153 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d58e7f83-7f3b-4a8d-941e-33f8d74e3810 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:00.498283 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-d58e7f83-7f3b-4a8d-941e-33f8d74e3810 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:00.506241 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-d58e7f83-7f3b-4a8d-941e-33f8d74e3810 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1723 microversion: 2.1 time: 0.136598 Sep 02 17:16:00.506824 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 612/1149] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:00 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1723 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:01.522819 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-b49e79be-5b0e-4ecc-bf3a-280f2b79ca13 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:01.523391 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-b49e79be-5b0e-4ecc-bf3a-280f2b79ca13 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:01.529751 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b49e79be-5b0e-4ecc-bf3a-280f2b79ca13 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:01.530197 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b49e79be-5b0e-4ecc-bf3a-280f2b79ca13 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:01.530988 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b49e79be-5b0e-4ecc-bf3a-280f2b79ca13 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:01.531419 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b49e79be-5b0e-4ecc-bf3a-280f2b79ca13 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:01.651648 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-b49e79be-5b0e-4ecc-bf3a-280f2b79ca13 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:01.659975 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-b49e79be-5b0e-4ecc-bf3a-280f2b79ca13 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1723 microversion: 2.1 time: 0.140885 Sep 02 17:16:01.660536 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 538/1150] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:01 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1723 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:02.676758 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-439dcd14-5b4c-414c-b6a9-5eaa03b0134e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:02.677366 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-439dcd14-5b4c-414c-b6a9-5eaa03b0134e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:02.683183 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-439dcd14-5b4c-414c-b6a9-5eaa03b0134e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:02.683623 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-439dcd14-5b4c-414c-b6a9-5eaa03b0134e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:02.684372 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-439dcd14-5b4c-414c-b6a9-5eaa03b0134e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:02.684798 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-439dcd14-5b4c-414c-b6a9-5eaa03b0134e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:02.804780 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-439dcd14-5b4c-414c-b6a9-5eaa03b0134e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:02.812540 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-439dcd14-5b4c-414c-b6a9-5eaa03b0134e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1700 microversion: 2.1 time: 0.139421 Sep 02 17:16:02.813092 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 613/1151] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:02 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1700 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:02.828313 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-849ad35f-1801-4ef4-bb35-8338e5796238 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:16:02.834209 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-849ad35f-1801-4ef4-bb35-8338e5796238 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:02.834678 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-849ad35f-1801-4ef4-bb35-8338e5796238 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:02.856201 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-849ad35f-1801-4ef4-bb35-8338e5796238 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Going to try to start instance {{(pid=108417) start /opt/stack/nova/nova/compute/api.py:2674}} Sep 02 17:16:02.895387 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-849ad35f-1801-4ef4-bb35-8338e5796238 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 202 len: 0 microversion: 2.1 time: 0.070536 Sep 02 17:16:02.895966 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 539/1152] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:16:02 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:16:02.904370 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-0c12f8b1-1f7b-467b-9239-a479ce4d93c8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:02.904986 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-0c12f8b1-1f7b-467b-9239-a479ce4d93c8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:02.910874 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-0c12f8b1-1f7b-467b-9239-a479ce4d93c8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:02.911304 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-0c12f8b1-1f7b-467b-9239-a479ce4d93c8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:02.912050 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-0c12f8b1-1f7b-467b-9239-a479ce4d93c8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:02.912487 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-0c12f8b1-1f7b-467b-9239-a479ce4d93c8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:03.034411 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-0c12f8b1-1f7b-467b-9239-a479ce4d93c8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:03.042432 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-0c12f8b1-1f7b-467b-9239-a479ce4d93c8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1709 microversion: 2.1 time: 0.142173 Sep 02 17:16:03.043216 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 614/1153] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:02 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1709 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:04.059919 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-d48771aa-211b-42c1-9e98-84d9a9043776 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:04.060629 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-d48771aa-211b-42c1-9e98-84d9a9043776 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:04.066645 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d48771aa-211b-42c1-9e98-84d9a9043776 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:04.067098 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d48771aa-211b-42c1-9e98-84d9a9043776 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:04.067848 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d48771aa-211b-42c1-9e98-84d9a9043776 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:04.068276 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d48771aa-211b-42c1-9e98-84d9a9043776 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:04.429714 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-d48771aa-211b-42c1-9e98-84d9a9043776 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:04.437277 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-d48771aa-211b-42c1-9e98-84d9a9043776 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1709 microversion: 2.1 time: 0.381454 Sep 02 17:16:04.437824 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 540/1154] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:04 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1709 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:04.754100 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-9c676367-7207-4a23-a598-64f12d67ec39 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:04.755100 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-9c676367-7207-4a23-a598-64f12d67ec39 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:04.760860 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9c676367-7207-4a23-a598-64f12d67ec39 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:04.761304 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9c676367-7207-4a23-a598-64f12d67ec39 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:04.762059 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9c676367-7207-4a23-a598-64f12d67ec39 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:04.762489 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9c676367-7207-4a23-a598-64f12d67ec39 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:04.790644 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-9c676367-7207-4a23-a598-64f12d67ec39 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.040280 Sep 02 17:16:04.791196 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 615/1155] 10.222.0.41 () {60 vars in 1343 bytes} [Thu Sep 2 17:16:04 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:04.849312 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-4ac34e67-d55e-4288-bb4e-a28f19978d75 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:04.849811 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-4ac34e67-d55e-4288-bb4e-a28f19978d75 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:04.855574 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4ac34e67-d55e-4288-bb4e-a28f19978d75 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:04.856019 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4ac34e67-d55e-4288-bb4e-a28f19978d75 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:04.857425 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4ac34e67-d55e-4288-bb4e-a28f19978d75 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:04.857862 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4ac34e67-d55e-4288-bb4e-a28f19978d75 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:04.881526 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-4ac34e67-d55e-4288-bb4e-a28f19978d75 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Going to try to terminate instance {{(pid=108417) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 17:16:04.955865 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-4ac34e67-d55e-4288-bb4e-a28f19978d75 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "DELETE /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 204 len: 0 microversion: 2.20 time: 0.109698 Sep 02 17:16:04.956365 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 541/1156] 10.222.0.41 () {60 vars in 1280 bytes} [Thu Sep 2 17:16:04 2021] DELETE /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 02 17:16:04.966438 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-8a3d175e-4877-46d2-98ba-6e15b5fb62b0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:04.967076 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-8a3d175e-4877-46d2-98ba-6e15b5fb62b0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:04.973673 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8a3d175e-4877-46d2-98ba-6e15b5fb62b0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:04.974148 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8a3d175e-4877-46d2-98ba-6e15b5fb62b0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:04.974935 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8a3d175e-4877-46d2-98ba-6e15b5fb62b0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:04.975370 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8a3d175e-4877-46d2-98ba-6e15b5fb62b0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:05.092223 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-8a3d175e-4877-46d2-98ba-6e15b5fb62b0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:05.099800 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-8a3d175e-4877-46d2-98ba-6e15b5fb62b0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:05.101275 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-8a3d175e-4877-46d2-98ba-6e15b5fb62b0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:05.102437 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-8a3d175e-4877-46d2-98ba-6e15b5fb62b0 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1724 microversion: 2.20 time: 0.140663 Sep 02 17:16:05.103003 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 616/1157] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:16:04 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1724 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:16:05.454922 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-75e36c51-7088-4dd4-8ef4-c8da59ecdca9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:05.455634 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-75e36c51-7088-4dd4-8ef4-c8da59ecdca9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:05.461407 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-75e36c51-7088-4dd4-8ef4-c8da59ecdca9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:05.461858 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-75e36c51-7088-4dd4-8ef4-c8da59ecdca9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:05.462642 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-75e36c51-7088-4dd4-8ef4-c8da59ecdca9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:05.463079 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-75e36c51-7088-4dd4-8ef4-c8da59ecdca9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:05.579413 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-75e36c51-7088-4dd4-8ef4-c8da59ecdca9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:05.587007 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-75e36c51-7088-4dd4-8ef4-c8da59ecdca9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1713 microversion: 2.1 time: 0.136671 Sep 02 17:16:05.587574 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 542/1158] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:05 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1713 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:06.120724 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-7f87b655-dcfb-4e6b-90b3-cd24316255a2 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:06.121338 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-7f87b655-dcfb-4e6b-90b3-cd24316255a2 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:06.128238 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7f87b655-dcfb-4e6b-90b3-cd24316255a2 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:06.128688 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7f87b655-dcfb-4e6b-90b3-cd24316255a2 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:06.129455 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7f87b655-dcfb-4e6b-90b3-cd24316255a2 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:06.129894 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7f87b655-dcfb-4e6b-90b3-cd24316255a2 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:06.249721 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-7f87b655-dcfb-4e6b-90b3-cd24316255a2 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:06.257296 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-7f87b655-dcfb-4e6b-90b3-cd24316255a2 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:06.258817 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-7f87b655-dcfb-4e6b-90b3-cd24316255a2 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:06.259964 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-7f87b655-dcfb-4e6b-90b3-cd24316255a2 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1724 microversion: 2.20 time: 0.142962 Sep 02 17:16:06.260520 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 617/1159] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:16:06 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1724 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:16:07.277833 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-820252cf-f6ac-44f3-bb98-b4b49f075b47 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:07.278972 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-820252cf-f6ac-44f3-bb98-b4b49f075b47 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:07.285204 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-820252cf-f6ac-44f3-bb98-b4b49f075b47 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:07.285650 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-820252cf-f6ac-44f3-bb98-b4b49f075b47 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:07.286829 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-820252cf-f6ac-44f3-bb98-b4b49f075b47 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:07.287270 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-820252cf-f6ac-44f3-bb98-b4b49f075b47 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:07.349802 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-820252cf-f6ac-44f3-bb98-b4b49f075b47 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:07.358954 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-820252cf-f6ac-44f3-bb98-b4b49f075b47 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:07.360749 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-820252cf-f6ac-44f3-bb98-b4b49f075b47 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd11ab044b0ba41be87b038204b161d8f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d941aa2c0e4b9eac9950e6e8237615', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:07.361900 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-820252cf-f6ac-44f3-bb98-b4b49f075b47 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 200 len: 1656 microversion: 2.20 time: 0.088266 Sep 02 17:16:07.362451 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 543/1160] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:16:07 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 1656 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 02 17:16:07.534010 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-f7572d18-0fbe-475c-903f-1cd7ef0032ee req-f4aa6498-87bb-4c78-a4d9-5b7984de3c14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41c895d8-bf14-4b23-8657-02bf702bb50c", "name": "network-vif-deleted", "tag": "88ce9e99-9c0c-4984-9fbe-83639825e7cc"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:16:07.536654 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:16:07.536654 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:16:07.544343 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-f7572d18-0fbe-475c-903f-1cd7ef0032ee req-f4aa6498-87bb-4c78-a4d9-5b7984de3c14 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:07.544786 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-f7572d18-0fbe-475c-903f-1cd7ef0032ee req-f4aa6498-87bb-4c78-a4d9-5b7984de3c14 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:07.556176 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-f7572d18-0fbe-475c-903f-1cd7ef0032ee req-f4aa6498-87bb-4c78-a4d9-5b7984de3c14 service nova] Creating event network-vif-deleted:88ce9e99-9c0c-4984-9fbe-83639825e7cc for instance 41c895d8-bf14-4b23-8657-02bf702bb50c on hv-cinder-80626 Sep 02 17:16:07.561232 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-f7572d18-0fbe-475c-903f-1cd7ef0032ee req-f4aa6498-87bb-4c78-a4d9-5b7984de3c14 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030806 Sep 02 17:16:07.562287 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 618/1161] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:16:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:16:08.381024 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-01dab633-7c95-4d2f-8f7f-c3f39800d3d6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:08.381717 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-01dab633-7c95-4d2f-8f7f-c3f39800d3d6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:08.387820 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-01dab633-7c95-4d2f-8f7f-c3f39800d3d6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:08.388424 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-01dab633-7c95-4d2f-8f7f-c3f39800d3d6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:08.389306 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-01dab633-7c95-4d2f-8f7f-c3f39800d3d6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:08.389828 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-01dab633-7c95-4d2f-8f7f-c3f39800d3d6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:08.403635 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.wsgi [None req-01dab633-7c95-4d2f-8f7f-c3f39800d3d6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] HTTP exception thrown: Instance 41c895d8-bf14-4b23-8657-02bf702bb50c could not be found. Sep 02 17:16:08.404248 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-01dab633-7c95-4d2f-8f7f-c3f39800d3d6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Returning 404 to user: Instance 41c895d8-bf14-4b23-8657-02bf702bb50c could not be found. {{(pid=108417) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:16:08.405100 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-01dab633-7c95-4d2f-8f7f-c3f39800d3d6 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 404 len: 111 microversion: 2.20 time: 0.027777 Sep 02 17:16:08.405877 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 544/1162] 10.222.0.41 () {60 vars in 1277 bytes} [Thu Sep 2 17:16:08 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 02 17:16:08.414590 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-d4fd9f63-9ffe-41d8-ba86-05c279399582 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '.version_select at 0x7fca986471f0>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:08.433897 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-d4fd9f63-9ffe-41d8-ba86-05c279399582 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2014514500" status: 204 len: 0 microversion: 2.20 time: 0.023336 Sep 02 17:16:08.434492 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 619/1163] 10.222.0.41 () {60 vars in 1262 bytes} [Thu Sep 2 17:16:08 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2014514500 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 02 17:16:10.407928 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-f1c69aca-ccac-406c-9907-4c400f5c6931 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:10.408427 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-f1c69aca-ccac-406c-9907-4c400f5c6931 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:10.414193 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f1c69aca-ccac-406c-9907-4c400f5c6931 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:10.414663 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f1c69aca-ccac-406c-9907-4c400f5c6931 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:10.415431 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f1c69aca-ccac-406c-9907-4c400f5c6931 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:10.415895 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f1c69aca-ccac-406c-9907-4c400f5c6931 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:10.428686 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.wsgi [None req-f1c69aca-ccac-406c-9907-4c400f5c6931 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] HTTP exception thrown: Instance 41c895d8-bf14-4b23-8657-02bf702bb50c could not be found. Sep 02 17:16:10.429262 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-f1c69aca-ccac-406c-9907-4c400f5c6931 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Returning 404 to user: Instance 41c895d8-bf14-4b23-8657-02bf702bb50c could not be found. {{(pid=108417) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:16:10.430070 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-f1c69aca-ccac-406c-9907-4c400f5c6931 tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "DELETE /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 404 len: 111 microversion: 2.1 time: 0.026407 Sep 02 17:16:10.430577 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 545/1164] 10.222.0.41 () {58 vars in 1239 bytes} [Thu Sep 2 17:16:10 2021] DELETE /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 17:16:10.438124 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-f14245e2-cee5-49a2-8822-4f8a9cfdc8ed tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:10.438909 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-f14245e2-cee5-49a2-8822-4f8a9cfdc8ed tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 41c895d8-bf14-4b23-8657-02bf702bb50c] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:10.444862 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f14245e2-cee5-49a2-8822-4f8a9cfdc8ed tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:10.445308 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f14245e2-cee5-49a2-8822-4f8a9cfdc8ed tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:10.446069 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f14245e2-cee5-49a2-8822-4f8a9cfdc8ed tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:10.446501 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f14245e2-cee5-49a2-8822-4f8a9cfdc8ed tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:10.460112 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.wsgi [None req-f14245e2-cee5-49a2-8822-4f8a9cfdc8ed tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] HTTP exception thrown: Instance 41c895d8-bf14-4b23-8657-02bf702bb50c could not be found. Sep 02 17:16:10.460711 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-f14245e2-cee5-49a2-8822-4f8a9cfdc8ed tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Returning 404 to user: Instance 41c895d8-bf14-4b23-8657-02bf702bb50c could not be found. {{(pid=108418) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:16:10.461514 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-f14245e2-cee5-49a2-8822-4f8a9cfdc8ed tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c" status: 404 len: 111 microversion: 2.1 time: 0.027179 Sep 02 17:16:10.462020 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 620/1165] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:10 2021] GET /compute/v2.1/servers/41c895d8-bf14-4b23-8657-02bf702bb50c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 17:16:11.590147 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-9147f045-ba83-4721-9c0d-eac4701de10b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:11.591287 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-9147f045-ba83-4721-9c0d-eac4701de10b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:11.597295 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9147f045-ba83-4721-9c0d-eac4701de10b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:11.597742 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9147f045-ba83-4721-9c0d-eac4701de10b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:11.598506 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9147f045-ba83-4721-9c0d-eac4701de10b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:11.598962 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9147f045-ba83-4721-9c0d-eac4701de10b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:11.612244 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.wsgi [None req-9147f045-ba83-4721-9c0d-eac4701de10b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] HTTP exception thrown: Instance 4e92c68a-a864-4562-b08b-d244394268ce could not be found. Sep 02 17:16:11.612823 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-9147f045-ba83-4721-9c0d-eac4701de10b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Returning 404 to user: Instance 4e92c68a-a864-4562-b08b-d244394268ce could not be found. {{(pid=108417) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:16:11.613655 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-9147f045-ba83-4721-9c0d-eac4701de10b tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "DELETE /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 404 len: 111 microversion: 2.1 time: 0.027547 Sep 02 17:16:11.614189 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 546/1166] 10.222.0.41 () {58 vars in 1239 bytes} [Thu Sep 2 17:16:11 2021] DELETE /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 17:16:11.622092 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-17fe3e80-fe49-466c-a7eb-ab60907d67bf tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:11.622732 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-17fe3e80-fe49-466c-a7eb-ab60907d67bf tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] [instance: 4e92c68a-a864-4562-b08b-d244394268ce] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:11.628419 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-17fe3e80-fe49-466c-a7eb-ab60907d67bf tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:11.628873 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-17fe3e80-fe49-466c-a7eb-ab60907d67bf tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:11.629627 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-17fe3e80-fe49-466c-a7eb-ab60907d67bf tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:11.630061 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-17fe3e80-fe49-466c-a7eb-ab60907d67bf tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:11.640061 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-f76c7dc9-2acf-47f3-827b-d5b5b40fdc24 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:16:11.640596 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-f76c7dc9-2acf-47f3-827b-d5b5b40fdc24 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:11.643047 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.wsgi [None req-17fe3e80-fe49-466c-a7eb-ab60907d67bf tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] HTTP exception thrown: Instance 4e92c68a-a864-4562-b08b-d244394268ce could not be found. Sep 02 17:16:11.643629 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-17fe3e80-fe49-466c-a7eb-ab60907d67bf tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] Returning 404 to user: Instance 4e92c68a-a864-4562-b08b-d244394268ce could not be found. {{(pid=108418) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:16:11.644445 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-17fe3e80-fe49-466c-a7eb-ab60907d67bf tempest-AttachVolumeShelveTestJSON-1551946697 tempest-AttachVolumeShelveTestJSON-1551946697-project] 10.222.0.41 "GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce" status: 404 len: 111 microversion: 2.1 time: 0.026046 Sep 02 17:16:11.644964 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 621/1167] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:11 2021] GET /compute/v2.1/servers/4e92c68a-a864-4562-b08b-d244394268ce => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 17:16:11.646463 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f76c7dc9-2acf-47f3-827b-d5b5b40fdc24 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:11.646943 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f76c7dc9-2acf-47f3-827b-d5b5b40fdc24 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:11.647712 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f76c7dc9-2acf-47f3-827b-d5b5b40fdc24 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:11.648244 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f76c7dc9-2acf-47f3-827b-d5b5b40fdc24 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:11.671653 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.objects.instance [None req-f76c7dc9-2acf-47f3-827b-d5b5b40fdc24 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lazy-loading 'flavor' on Instance uuid cea6ec2a-41c7-41c5-8471-3da2ba130315 {{(pid=108417) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 17:16:11.740673 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-f76c7dc9-2acf-47f3-827b-d5b5b40fdc24 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "POST /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315/action" status: 202 len: 0 microversion: 2.1 time: 0.104181 Sep 02 17:16:11.741839 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 547/1168] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:16:11 2021] POST /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:16:11.749958 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-4d3b5c9b-c11a-4fda-a1e8-51f6e31d67f2 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:11.750578 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-4d3b5c9b-c11a-4fda-a1e8-51f6e31d67f2 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:11.757129 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4d3b5c9b-c11a-4fda-a1e8-51f6e31d67f2 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:11.757496 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4d3b5c9b-c11a-4fda-a1e8-51f6e31d67f2 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:11.758318 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4d3b5c9b-c11a-4fda-a1e8-51f6e31d67f2 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:11.758784 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4d3b5c9b-c11a-4fda-a1e8-51f6e31d67f2 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:12.007240 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-4d3b5c9b-c11a-4fda-a1e8-51f6e31d67f2 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:12.014351 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-4d3b5c9b-c11a-4fda-a1e8-51f6e31d67f2 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1566 microversion: 2.1 time: 0.268351 Sep 02 17:16:12.014940 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 622/1169] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:11 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1566 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:13.036277 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-2911eb80-ae0c-400b-acda-3d35cbde1cc0 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:13.037081 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-2911eb80-ae0c-400b-acda-3d35cbde1cc0 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:13.043893 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2911eb80-ae0c-400b-acda-3d35cbde1cc0 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:13.044429 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2911eb80-ae0c-400b-acda-3d35cbde1cc0 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:13.045287 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2911eb80-ae0c-400b-acda-3d35cbde1cc0 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:13.045794 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2911eb80-ae0c-400b-acda-3d35cbde1cc0 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:13.166466 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-2911eb80-ae0c-400b-acda-3d35cbde1cc0 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:13.173714 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-2911eb80-ae0c-400b-acda-3d35cbde1cc0 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1566 microversion: 2.1 time: 0.142424 Sep 02 17:16:13.174274 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 548/1170] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:13 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1566 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:14.191694 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-8911a506-3716-4b42-919a-62fe7d2c02f1 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:14.193122 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-8911a506-3716-4b42-919a-62fe7d2c02f1 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:14.199689 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8911a506-3716-4b42-919a-62fe7d2c02f1 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:14.200215 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8911a506-3716-4b42-919a-62fe7d2c02f1 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:14.201065 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8911a506-3716-4b42-919a-62fe7d2c02f1 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:14.201714 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8911a506-3716-4b42-919a-62fe7d2c02f1 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:14.454987 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-8911a506-3716-4b42-919a-62fe7d2c02f1 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:14.462978 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-8911a506-3716-4b42-919a-62fe7d2c02f1 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1566 microversion: 2.1 time: 0.275352 Sep 02 17:16:14.463547 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 623/1171] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:14 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1566 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:15.481160 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-fd16c4d4-82f7-4705-81c2-579c8f6e9dfc tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:15.481805 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-fd16c4d4-82f7-4705-81c2-579c8f6e9dfc tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:15.490212 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fd16c4d4-82f7-4705-81c2-579c8f6e9dfc tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:15.490874 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fd16c4d4-82f7-4705-81c2-579c8f6e9dfc tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:15.491809 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fd16c4d4-82f7-4705-81c2-579c8f6e9dfc tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:15.492237 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fd16c4d4-82f7-4705-81c2-579c8f6e9dfc tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:15.625766 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-fd16c4d4-82f7-4705-81c2-579c8f6e9dfc tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:15.633485 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-fd16c4d4-82f7-4705-81c2-579c8f6e9dfc tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1566 microversion: 2.1 time: 0.156181 Sep 02 17:16:15.634049 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 549/1172] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:15 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:16.650250 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-c704ed90-e0e2-41f9-9d72-b70328e3e656 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:16.650882 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-c704ed90-e0e2-41f9-9d72-b70328e3e656 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:16.657148 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c704ed90-e0e2-41f9-9d72-b70328e3e656 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:16.657594 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c704ed90-e0e2-41f9-9d72-b70328e3e656 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:16.658386 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c704ed90-e0e2-41f9-9d72-b70328e3e656 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:16.658855 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c704ed90-e0e2-41f9-9d72-b70328e3e656 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:16.783157 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-c704ed90-e0e2-41f9-9d72-b70328e3e656 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:16.790386 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-c704ed90-e0e2-41f9-9d72-b70328e3e656 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1566 microversion: 2.1 time: 0.143813 Sep 02 17:16:16.790975 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 624/1173] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:16 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1566 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:17.578550 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-2ada266c-63fe-43ae-8c44-88b1ee8f01b8 tempest-VolumesTestJSON-109376604 tempest-VolumesTestJSON-109376604-project] Calling method '.version_select at 0x7fca984cb5e0>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:17.628599 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-2ada266c-63fe-43ae-8c44-88b1ee8f01b8 tempest-VolumesTestJSON-109376604 tempest-VolumesTestJSON-109376604-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/8f933aee-40f0-46be-91e4-ba4ed6401b83" status: 200 len: 351 microversion: 2.1 time: 0.053569 Sep 02 17:16:17.629159 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 550/1174] 10.222.0.41 () {58 vars in 1245 bytes} [Thu Sep 2 17:16:17 2021] GET /compute/v2.1/os-volumes/8f933aee-40f0-46be-91e4-ba4ed6401b83 => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:16:17.807234 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-882519c2-5d2c-4a3d-88bf-59e9784bba72 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:17.807852 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-882519c2-5d2c-4a3d-88bf-59e9784bba72 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:17.813734 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-882519c2-5d2c-4a3d-88bf-59e9784bba72 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:17.814196 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-882519c2-5d2c-4a3d-88bf-59e9784bba72 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:17.815245 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-882519c2-5d2c-4a3d-88bf-59e9784bba72 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:17.815432 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-882519c2-5d2c-4a3d-88bf-59e9784bba72 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:17.944587 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-882519c2-5d2c-4a3d-88bf-59e9784bba72 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:17.951924 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-882519c2-5d2c-4a3d-88bf-59e9784bba72 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1566 microversion: 2.1 time: 0.148279 Sep 02 17:16:17.952478 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 625/1175] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:17 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1566 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:18.957300 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-4ab043d2-9715-4567-a4f5-6001b6d3c2fe tempest-VolumesTestJSON-109376604 tempest-VolumesTestJSON-109376604-project] Calling method '.version_select at 0x7fca984abca0>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:18.968914 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-a1ae6e3c-c9f9-447a-8a39-8ed2ad802717 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:18.969769 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-a1ae6e3c-c9f9-447a-8a39-8ed2ad802717 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:18.975516 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a1ae6e3c-c9f9-447a-8a39-8ed2ad802717 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:18.975969 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a1ae6e3c-c9f9-447a-8a39-8ed2ad802717 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:18.976766 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a1ae6e3c-c9f9-447a-8a39-8ed2ad802717 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:18.977199 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a1ae6e3c-c9f9-447a-8a39-8ed2ad802717 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:19.008200 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-4ab043d2-9715-4567-a4f5-6001b6d3c2fe tempest-VolumesTestJSON-109376604 tempest-VolumesTestJSON-109376604-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/8aa11680-f5ad-4456-8515-de7d597853ac" status: 200 len: 350 microversion: 2.1 time: 0.054356 Sep 02 17:16:19.008847 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 551/1176] 10.222.0.41 () {58 vars in 1245 bytes} [Thu Sep 2 17:16:18 2021] GET /compute/v2.1/os-volumes/8aa11680-f5ad-4456-8515-de7d597853ac => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:16:19.099254 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-a1ae6e3c-c9f9-447a-8a39-8ed2ad802717 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:19.106925 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-a1ae6e3c-c9f9-447a-8a39-8ed2ad802717 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1566 microversion: 2.1 time: 0.142153 Sep 02 17:16:19.107488 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 626/1177] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:18 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1566 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:16:20.124494 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-4c3ba213-ac83-4a1f-a774-c839543dba6f tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:20.125039 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-4c3ba213-ac83-4a1f-a774-c839543dba6f tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:20.131578 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4c3ba213-ac83-4a1f-a774-c839543dba6f tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:20.132027 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4c3ba213-ac83-4a1f-a774-c839543dba6f tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:20.132790 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4c3ba213-ac83-4a1f-a774-c839543dba6f tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:20.133227 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4c3ba213-ac83-4a1f-a774-c839543dba6f tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:20.253519 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-4c3ba213-ac83-4a1f-a774-c839543dba6f tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:20.260838 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-4c3ba213-ac83-4a1f-a774-c839543dba6f tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1566 microversion: 2.1 time: 0.140558 Sep 02 17:16:20.261389 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 552/1178] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:20 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1566 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:20.327288 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-4265af55-d482-468f-b69c-75c8ff08d7f9 tempest-VolumesTestJSON-109376604 tempest-VolumesTestJSON-109376604-project] Calling method '.version_select at 0x7fca9d2f10d0>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:20.377956 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-4265af55-d482-468f-b69c-75c8ff08d7f9 tempest-VolumesTestJSON-109376604 tempest-VolumesTestJSON-109376604-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/6e9326ab-2f2b-4790-a448-09abc1670c5e" status: 200 len: 351 microversion: 2.1 time: 0.054175 Sep 02 17:16:20.378524 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 627/1179] 10.222.0.41 () {58 vars in 1245 bytes} [Thu Sep 2 17:16:20 2021] GET /compute/v2.1/os-volumes/6e9326ab-2f2b-4790-a448-09abc1670c5e => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:16:20.389046 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-d86d3206-c2bd-4f9d-a172-2e37b6bfbfd3 tempest-VolumesTestJSON-109376604 tempest-VolumesTestJSON-109376604-project] Calling method '.version_select at 0x7fca9849ae50>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:20.468270 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-d86d3206-c2bd-4f9d-a172-2e37b6bfbfd3 tempest-VolumesTestJSON-109376604 tempest-VolumesTestJSON-109376604-project] 10.222.0.41 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.082669 Sep 02 17:16:20.468845 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 553/1180] 10.222.0.41 () {58 vars in 1134 bytes} [Thu Sep 2 17:16:20 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:20.480260 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-98b25621-1ebf-4f91-871e-b88682177e0d tempest-VolumesTestJSON-109376604 tempest-VolumesTestJSON-109376604-project] Calling method '.version_select at 0x7fca9d2f1c10>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:20.559882 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-98b25621-1ebf-4f91-871e-b88682177e0d tempest-VolumesTestJSON-109376604 tempest-VolumesTestJSON-109376604-project] 10.222.0.41 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.083064 Sep 02 17:16:20.560444 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 628/1181] 10.222.0.41 () {58 vars in 1149 bytes} [Thu Sep 2 17:16:20 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:16:20.571706 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-23cd432e-7edd-4bb7-8871-6eff7cb0df0b tempest-VolumesTestJSON-109376604 tempest-VolumesTestJSON-109376604-project] Calling method '.version_select at 0x7fca984cb5e0>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:20.648230 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-23cd432e-7edd-4bb7-8871-6eff7cb0df0b tempest-VolumesTestJSON-109376604 tempest-VolumesTestJSON-109376604-project] 10.222.0.41 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.080058 Sep 02 17:16:20.648949 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 554/1182] 10.222.0.41 () {58 vars in 1134 bytes} [Thu Sep 2 17:16:20 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:20.660214 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-32b2aa7c-1810-426f-aa80-2e52152e0616 tempest-VolumesTestJSON-109376604 tempest-VolumesTestJSON-109376604-project] Calling method '.version_select at 0x7fca9d2ee280>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:20.739834 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-32b2aa7c-1810-426f-aa80-2e52152e0616 tempest-VolumesTestJSON-109376604 tempest-VolumesTestJSON-109376604-project] 10.222.0.41 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.083225 Sep 02 17:16:20.740396 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 629/1183] 10.222.0.41 () {58 vars in 1167 bytes} [Thu Sep 2 17:16:20 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:16:20.751803 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-38d3142d-0fc3-4a7f-9276-775d32691ebe tempest-VolumesTestJSON-109376604 tempest-VolumesTestJSON-109376604-project] Calling method '.version_select at 0x7fca984ca5e0>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:20.829663 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-38d3142d-0fc3-4a7f-9276-775d32691ebe tempest-VolumesTestJSON-109376604 tempest-VolumesTestJSON-109376604-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.081332 Sep 02 17:16:20.830225 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 555/1184] 10.222.0.41 () {58 vars in 1170 bytes} [Thu Sep 2 17:16:20 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:16:20.842011 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-d4e84073-e642-4eb0-a429-1e2a168e82f0 tempest-VolumesTestJSON-109376604 tempest-VolumesTestJSON-109376604-project] Calling method '.version_select at 0x7fca98510040>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:20.921912 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-d4e84073-e642-4eb0-a429-1e2a168e82f0 tempest-VolumesTestJSON-109376604 tempest-VolumesTestJSON-109376604-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.083854 Sep 02 17:16:20.922493 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 630/1185] 10.222.0.41 () {58 vars in 1155 bytes} [Thu Sep 2 17:16:20 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:20.933324 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-c633ea3d-4f24-4d71-8c48-032910852452 tempest-VolumesTestJSON-109376604 tempest-VolumesTestJSON-109376604-project] Calling method '.version_select at 0x7fca984cadc0>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:21.162769 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-c633ea3d-4f24-4d71-8c48-032910852452 tempest-VolumesTestJSON-109376604 tempest-VolumesTestJSON-109376604-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.232953 Sep 02 17:16:21.163324 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 556/1186] 10.222.0.41 () {58 vars in 1188 bytes} [Thu Sep 2 17:16:20 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:16:21.174382 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-296536ee-1448-4281-b540-189387099481 tempest-VolumesTestJSON-109376604 tempest-VolumesTestJSON-109376604-project] Calling method '.version_select at 0x7fca986471f0>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:21.253245 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-296536ee-1448-4281-b540-189387099481 tempest-VolumesTestJSON-109376604 tempest-VolumesTestJSON-109376604-project] 10.222.0.41 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.082317 Sep 02 17:16:21.253809 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 631/1187] 10.222.0.41 () {58 vars in 1155 bytes} [Thu Sep 2 17:16:21 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:21.276733 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-a41106e7-24f7-4ddf-86e6-b10cc4658acf tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:21.277343 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-a41106e7-24f7-4ddf-86e6-b10cc4658acf tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:21.283220 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a41106e7-24f7-4ddf-86e6-b10cc4658acf tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:21.283666 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a41106e7-24f7-4ddf-86e6-b10cc4658acf tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:21.284702 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a41106e7-24f7-4ddf-86e6-b10cc4658acf tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:21.284990 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a41106e7-24f7-4ddf-86e6-b10cc4658acf tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:21.407924 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-a41106e7-24f7-4ddf-86e6-b10cc4658acf tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:21.415292 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-a41106e7-24f7-4ddf-86e6-b10cc4658acf tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1566 microversion: 2.1 time: 0.142096 Sep 02 17:16:21.415793 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 557/1188] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:21 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1566 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:22.433407 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-eb854f9e-773a-4a87-bf29-adcccb6b40db tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:22.434011 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-eb854f9e-773a-4a87-bf29-adcccb6b40db tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:22.444285 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-eb854f9e-773a-4a87-bf29-adcccb6b40db tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:22.444737 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-eb854f9e-773a-4a87-bf29-adcccb6b40db tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:22.445507 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-eb854f9e-773a-4a87-bf29-adcccb6b40db tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:22.446274 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-eb854f9e-773a-4a87-bf29-adcccb6b40db tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:22.571561 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-eb854f9e-773a-4a87-bf29-adcccb6b40db tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:22.579300 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-eb854f9e-773a-4a87-bf29-adcccb6b40db tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1566 microversion: 2.1 time: 0.151131 Sep 02 17:16:22.579863 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 632/1189] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:22 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:23.596834 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-da0b4d0c-3ca5-420c-8901-172b8913d9f2 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:23.597442 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-da0b4d0c-3ca5-420c-8901-172b8913d9f2 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:23.603944 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-da0b4d0c-3ca5-420c-8901-172b8913d9f2 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:23.604402 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-da0b4d0c-3ca5-420c-8901-172b8913d9f2 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:23.613790 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-da0b4d0c-3ca5-420c-8901-172b8913d9f2 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:23.613790 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-da0b4d0c-3ca5-420c-8901-172b8913d9f2 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:23.725664 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-da0b4d0c-3ca5-420c-8901-172b8913d9f2 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:23.733542 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-da0b4d0c-3ca5-420c-8901-172b8913d9f2 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1566 microversion: 2.1 time: 0.140662 Sep 02 17:16:23.734092 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 558/1190] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:23 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1566 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:24.749861 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-803cd063-f599-42fe-a60f-c1b29577489a tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:24.750643 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-803cd063-f599-42fe-a60f-c1b29577489a tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:24.757058 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-803cd063-f599-42fe-a60f-c1b29577489a tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:24.757863 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-803cd063-f599-42fe-a60f-c1b29577489a tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:24.758824 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-803cd063-f599-42fe-a60f-c1b29577489a tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:24.759283 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-803cd063-f599-42fe-a60f-c1b29577489a tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:24.890613 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-803cd063-f599-42fe-a60f-c1b29577489a tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:24.900721 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-803cd063-f599-42fe-a60f-c1b29577489a tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1566 microversion: 2.1 time: 0.154459 Sep 02 17:16:24.901584 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 633/1191] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:24 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:25.918518 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-a60b5ccb-ec0a-45bb-8d24-c4e909c64d43 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:25.919188 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-a60b5ccb-ec0a-45bb-8d24-c4e909c64d43 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:25.926429 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a60b5ccb-ec0a-45bb-8d24-c4e909c64d43 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:25.926900 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a60b5ccb-ec0a-45bb-8d24-c4e909c64d43 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:25.927661 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a60b5ccb-ec0a-45bb-8d24-c4e909c64d43 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:25.928095 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a60b5ccb-ec0a-45bb-8d24-c4e909c64d43 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:26.047662 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-a60b5ccb-ec0a-45bb-8d24-c4e909c64d43 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:26.062963 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-a60b5ccb-ec0a-45bb-8d24-c4e909c64d43 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1507 microversion: 2.1 time: 0.148004 Sep 02 17:16:26.063566 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 559/1192] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:25 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:26.079590 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-2331cc17-7800-43da-af87-e368eaa199e4 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:16:26.080174 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-2331cc17-7800-43da-af87-e368eaa199e4 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:26.086028 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2331cc17-7800-43da-af87-e368eaa199e4 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:26.086474 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2331cc17-7800-43da-af87-e368eaa199e4 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:26.087270 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2331cc17-7800-43da-af87-e368eaa199e4 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:26.087700 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2331cc17-7800-43da-af87-e368eaa199e4 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:26.164574 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-2331cc17-7800-43da-af87-e368eaa199e4 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "POST /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315/action" status: 202 len: 0 microversion: 2.1 time: 0.089196 Sep 02 17:16:26.168469 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 634/1193] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:16:26 2021] POST /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:16:26.173227 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-44426be8-c626-464c-95c3-c562ce97b98a tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:26.174173 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-44426be8-c626-464c-95c3-c562ce97b98a tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:26.180087 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-44426be8-c626-464c-95c3-c562ce97b98a tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:26.180535 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-44426be8-c626-464c-95c3-c562ce97b98a tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:26.181301 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-44426be8-c626-464c-95c3-c562ce97b98a tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:26.181736 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-44426be8-c626-464c-95c3-c562ce97b98a tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:26.330618 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-44426be8-c626-464c-95c3-c562ce97b98a tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:26.338179 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-44426be8-c626-464c-95c3-c562ce97b98a tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1515 microversion: 2.1 time: 0.168814 Sep 02 17:16:26.338778 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 560/1194] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:26 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:16:27.355762 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-3a07380c-4a56-4f2d-94c6-24dd4d953900 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:27.356361 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-3a07380c-4a56-4f2d-94c6-24dd4d953900 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:27.362899 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3a07380c-4a56-4f2d-94c6-24dd4d953900 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:27.363356 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3a07380c-4a56-4f2d-94c6-24dd4d953900 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:27.364131 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3a07380c-4a56-4f2d-94c6-24dd4d953900 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:27.364608 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3a07380c-4a56-4f2d-94c6-24dd4d953900 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:27.505609 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-3a07380c-4a56-4f2d-94c6-24dd4d953900 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:27.513494 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-3a07380c-4a56-4f2d-94c6-24dd4d953900 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1517 microversion: 2.1 time: 0.161476 Sep 02 17:16:27.514873 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 635/1195] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:27 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:28.412728 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [req-02505a50-d720-4dbe-a79d-995e25735d01 req-f3f25b18-00d3-49b8-90cd-e129c870316e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cea6ec2a-41c7-41c5-8471-3da2ba130315", "name": "network-vif-unplugged", "status": "completed", "tag": "f0347608-2078-4ebd-b282-53b22f166ac6"}]} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:16:28.415609 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:16:28.415609 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: warnings.warn(msg) Sep 02 17:16:28.428814 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-02505a50-d720-4dbe-a79d-995e25735d01 req-f3f25b18-00d3-49b8-90cd-e129c870316e service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:28.429607 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-02505a50-d720-4dbe-a79d-995e25735d01 req-f3f25b18-00d3-49b8-90cd-e129c870316e service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:28.450206 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.compute.server_external_events [req-02505a50-d720-4dbe-a79d-995e25735d01 req-f3f25b18-00d3-49b8-90cd-e129c870316e service nova] Creating event network-vif-unplugged:f0347608-2078-4ebd-b282-53b22f166ac6 for instance cea6ec2a-41c7-41c5-8471-3da2ba130315 on hv-cinder-80626 Sep 02 17:16:28.458524 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [req-02505a50-d720-4dbe-a79d-995e25735d01 req-f3f25b18-00d3-49b8-90cd-e129c870316e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051629 Sep 02 17:16:28.459727 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 561/1196] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:16:28 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:16:28.531268 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-091fed61-3555-4a84-bd46-2e76b9c46e06 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:28.531887 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-091fed61-3555-4a84-bd46-2e76b9c46e06 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:28.537781 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-091fed61-3555-4a84-bd46-2e76b9c46e06 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:28.538226 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-091fed61-3555-4a84-bd46-2e76b9c46e06 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:28.539020 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-091fed61-3555-4a84-bd46-2e76b9c46e06 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:28.539456 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-091fed61-3555-4a84-bd46-2e76b9c46e06 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:28.659114 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-091fed61-3555-4a84-bd46-2e76b9c46e06 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:28.666453 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-091fed61-3555-4a84-bd46-2e76b9c46e06 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1573 microversion: 2.1 time: 0.138739 Sep 02 17:16:28.666964 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 636/1197] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:28 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1573 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:29.685017 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-9739c873-f164-4735-bb81-fe460d7ad228 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:29.685709 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-9739c873-f164-4735-bb81-fe460d7ad228 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:29.691691 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9739c873-f164-4735-bb81-fe460d7ad228 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:29.692145 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9739c873-f164-4735-bb81-fe460d7ad228 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:29.692932 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9739c873-f164-4735-bb81-fe460d7ad228 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:29.693367 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9739c873-f164-4735-bb81-fe460d7ad228 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:29.820657 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-9739c873-f164-4735-bb81-fe460d7ad228 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:29.828825 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-9739c873-f164-4735-bb81-fe460d7ad228 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1573 microversion: 2.1 time: 0.147940 Sep 02 17:16:29.829390 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 562/1198] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:29 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1573 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:30.845675 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-5b0a9059-684e-41c4-a739-943929f6784a tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:30.846318 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-5b0a9059-684e-41c4-a739-943929f6784a tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:30.852119 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5b0a9059-684e-41c4-a739-943929f6784a tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:30.852565 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5b0a9059-684e-41c4-a739-943929f6784a tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:30.853324 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5b0a9059-684e-41c4-a739-943929f6784a tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:30.853757 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5b0a9059-684e-41c4-a739-943929f6784a tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:30.971816 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-5b0a9059-684e-41c4-a739-943929f6784a tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:30.979023 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-5b0a9059-684e-41c4-a739-943929f6784a tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1573 microversion: 2.1 time: 0.137053 Sep 02 17:16:30.979580 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 637/1199] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:30 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1573 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:16:31.996507 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-b796b775-5e08-48d9-a5a3-029534667fd2 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:31.997118 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-b796b775-5e08-48d9-a5a3-029534667fd2 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:32.003995 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b796b775-5e08-48d9-a5a3-029534667fd2 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:32.004454 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b796b775-5e08-48d9-a5a3-029534667fd2 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:32.005222 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b796b775-5e08-48d9-a5a3-029534667fd2 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:32.005659 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b796b775-5e08-48d9-a5a3-029534667fd2 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:32.122279 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-b796b775-5e08-48d9-a5a3-029534667fd2 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:32.130191 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-b796b775-5e08-48d9-a5a3-029534667fd2 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1573 microversion: 2.1 time: 0.137403 Sep 02 17:16:32.130831 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 563/1200] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:31 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1573 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:33.147264 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-ce797970-2908-45cf-9fe4-75f91ee9f0ba tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:33.147824 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-ce797970-2908-45cf-9fe4-75f91ee9f0ba tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:33.153512 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ce797970-2908-45cf-9fe4-75f91ee9f0ba tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:33.153962 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ce797970-2908-45cf-9fe4-75f91ee9f0ba tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:33.155320 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ce797970-2908-45cf-9fe4-75f91ee9f0ba tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:33.155758 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ce797970-2908-45cf-9fe4-75f91ee9f0ba tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:33.277681 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-ce797970-2908-45cf-9fe4-75f91ee9f0ba tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:33.284907 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-ce797970-2908-45cf-9fe4-75f91ee9f0ba tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1573 microversion: 2.1 time: 0.141343 Sep 02 17:16:33.285454 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 638/1201] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:33 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1573 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:34.302111 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-e8855fd5-bd5c-484c-b42c-ea1bd112f670 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:34.302761 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-e8855fd5-bd5c-484c-b42c-ea1bd112f670 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:34.309196 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e8855fd5-bd5c-484c-b42c-ea1bd112f670 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:34.309646 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e8855fd5-bd5c-484c-b42c-ea1bd112f670 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:34.310408 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e8855fd5-bd5c-484c-b42c-ea1bd112f670 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:34.311383 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e8855fd5-bd5c-484c-b42c-ea1bd112f670 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:34.437564 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-e8855fd5-bd5c-484c-b42c-ea1bd112f670 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:34.445028 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-e8855fd5-bd5c-484c-b42c-ea1bd112f670 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1573 microversion: 2.1 time: 0.147488 Sep 02 17:16:34.445635 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 564/1202] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:34 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1573 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:35.461784 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-44aec807-0468-43f6-80f4-b30ad2543e81 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:35.462397 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-44aec807-0468-43f6-80f4-b30ad2543e81 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:35.468738 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-44aec807-0468-43f6-80f4-b30ad2543e81 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:35.469188 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-44aec807-0468-43f6-80f4-b30ad2543e81 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:35.469952 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-44aec807-0468-43f6-80f4-b30ad2543e81 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:35.470387 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-44aec807-0468-43f6-80f4-b30ad2543e81 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:35.586931 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-44aec807-0468-43f6-80f4-b30ad2543e81 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:35.594155 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-44aec807-0468-43f6-80f4-b30ad2543e81 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1573 microversion: 2.1 time: 0.136015 Sep 02 17:16:35.594736 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 639/1203] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:35 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1573 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:36.611095 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-70b052da-46d9-4201-992a-f01c780e6349 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:36.611700 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-70b052da-46d9-4201-992a-f01c780e6349 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:36.617737 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-70b052da-46d9-4201-992a-f01c780e6349 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:36.618185 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-70b052da-46d9-4201-992a-f01c780e6349 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:36.618976 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-70b052da-46d9-4201-992a-f01c780e6349 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:36.619409 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-70b052da-46d9-4201-992a-f01c780e6349 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:36.737111 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-70b052da-46d9-4201-992a-f01c780e6349 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:36.744844 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-70b052da-46d9-4201-992a-f01c780e6349 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1560 microversion: 2.1 time: 0.137514 Sep 02 17:16:36.745416 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 565/1204] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:36 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1560 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:38.531981 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-b13f88db-f317-4bb8-9155-24ff7f8a8666 req-4247f1c4-f890-4ba8-af33-11cf70aecaf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cea6ec2a-41c7-41c5-8471-3da2ba130315", "name": "network-vif-plugged", "status": "completed", "tag": "f0347608-2078-4ebd-b282-53b22f166ac6"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:16:38.534220 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:16:38.534220 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:16:38.541280 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-b13f88db-f317-4bb8-9155-24ff7f8a8666 req-4247f1c4-f890-4ba8-af33-11cf70aecaf8 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:38.541798 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-b13f88db-f317-4bb8-9155-24ff7f8a8666 req-4247f1c4-f890-4ba8-af33-11cf70aecaf8 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:38.554064 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-b13f88db-f317-4bb8-9155-24ff7f8a8666 req-4247f1c4-f890-4ba8-af33-11cf70aecaf8 service nova] Creating event network-vif-plugged:f0347608-2078-4ebd-b282-53b22f166ac6 for instance cea6ec2a-41c7-41c5-8471-3da2ba130315 on hv-cinder-80626 Sep 02 17:16:38.559051 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-b13f88db-f317-4bb8-9155-24ff7f8a8666 req-4247f1c4-f890-4ba8-af33-11cf70aecaf8 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031073 Sep 02 17:16:38.559617 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 640/1205] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:16:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:16:43.646136 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-3e22d0fb-42de-4c0e-ba4f-05ffa5773ebd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:43.646705 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-3e22d0fb-42de-4c0e-ba4f-05ffa5773ebd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:43.652414 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3e22d0fb-42de-4c0e-ba4f-05ffa5773ebd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:43.652853 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3e22d0fb-42de-4c0e-ba4f-05ffa5773ebd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:43.653599 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3e22d0fb-42de-4c0e-ba4f-05ffa5773ebd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:43.654024 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3e22d0fb-42de-4c0e-ba4f-05ffa5773ebd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:43.748473 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.objects.instance [None req-3e22d0fb-42de-4c0e-ba4f-05ffa5773ebd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lazy-loading 'services' on Instance uuid 77697955-515d-4f49-8b5e-8d01b670ff58 {{(pid=108417) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 17:16:43.817997 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-3e22d0fb-42de-4c0e-ba4f-05ffa5773ebd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "DELETE /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/os-volume_attachments/10273fcb-080d-4a74-8b33-f2a8bb4fe202" status: 202 len: 0 microversion: 2.1 time: 0.175396 Sep 02 17:16:43.818582 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 566/1206] 10.222.0.41 () {58 vars in 1416 bytes} [Thu Sep 2 17:16:43 2021] DELETE /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/os-volume_attachments/10273fcb-080d-4a74-8b33-f2a8bb4fe202 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:16:44.940163 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-67bb70e9-b6b1-4a7c-a4fb-0ef9ff929b7a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:16:44.946038 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-67bb70e9-b6b1-4a7c-a4fb-0ef9ff929b7a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:44.946484 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-67bb70e9-b6b1-4a7c-a4fb-0ef9ff929b7a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:45.013212 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-67bb70e9-b6b1-4a7c-a4fb-0ef9ff929b7a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Going to try to stop instance {{(pid=108418) force_stop /opt/stack/nova/nova/compute/api.py:2651}} Sep 02 17:16:45.060794 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-67bb70e9-b6b1-4a7c-a4fb-0ef9ff929b7a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 202 len: 0 microversion: 2.1 time: 0.125132 Sep 02 17:16:45.064962 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 641/1207] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:16:44 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:16:45.072535 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-5ad94bc8-315f-48f3-af9f-c1bf18bc209c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:45.073093 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-5ad94bc8-315f-48f3-af9f-c1bf18bc209c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:45.080544 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5ad94bc8-315f-48f3-af9f-c1bf18bc209c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:45.080991 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5ad94bc8-315f-48f3-af9f-c1bf18bc209c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:45.081755 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5ad94bc8-315f-48f3-af9f-c1bf18bc209c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:45.082211 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5ad94bc8-315f-48f3-af9f-c1bf18bc209c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:45.216250 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-5ad94bc8-315f-48f3-af9f-c1bf18bc209c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:45.228817 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-5ad94bc8-315f-48f3-af9f-c1bf18bc209c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1677 microversion: 2.1 time: 0.160697 Sep 02 17:16:45.229396 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 567/1208] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:45 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:46.247442 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-c93c8682-855f-4a0a-934b-a11387b6b1ea tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:46.248138 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-c93c8682-855f-4a0a-934b-a11387b6b1ea tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:46.253994 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c93c8682-855f-4a0a-934b-a11387b6b1ea tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:46.254442 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c93c8682-855f-4a0a-934b-a11387b6b1ea tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:46.255229 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c93c8682-855f-4a0a-934b-a11387b6b1ea tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:46.255662 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c93c8682-855f-4a0a-934b-a11387b6b1ea tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:46.390870 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-c93c8682-855f-4a0a-934b-a11387b6b1ea tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:46.398450 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-c93c8682-855f-4a0a-934b-a11387b6b1ea tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1677 microversion: 2.1 time: 0.155192 Sep 02 17:16:46.399240 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 642/1209] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:46 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:47.415640 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-317cea19-1fc4-4e17-b90f-b4e71386e4f2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:47.416253 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-317cea19-1fc4-4e17-b90f-b4e71386e4f2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:47.422697 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-317cea19-1fc4-4e17-b90f-b4e71386e4f2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:47.423152 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-317cea19-1fc4-4e17-b90f-b4e71386e4f2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:47.423914 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-317cea19-1fc4-4e17-b90f-b4e71386e4f2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:47.424348 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-317cea19-1fc4-4e17-b90f-b4e71386e4f2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:47.540330 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-317cea19-1fc4-4e17-b90f-b4e71386e4f2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:47.547462 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-317cea19-1fc4-4e17-b90f-b4e71386e4f2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1677 microversion: 2.1 time: 0.135483 Sep 02 17:16:47.548013 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 568/1210] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:47 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1677 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:47.900968 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-c5472481-cfee-463b-82c2-b5ef2bb59856 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1585363455", "imageRef": "22ce6e29-f3a7-49f0-b93a-ddbffa14e44e", "flavorRef": "452", "networks": [{"uuid": "9a4507ad-090b-4319-bc82-98ed0423ca3a"}]}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:16:47.953783 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.network.neutron [None req-c5472481-cfee-463b-82c2-b5ef2bb59856 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] validate_networks() for [('9a4507ad-090b-4319-bc82-98ed0423ca3a', None, None, None, None, None)] {{(pid=108418) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 17:16:48.286983 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-c5472481-cfee-463b-82c2-b5ef2bb59856 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Flavor limits 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 17:16:48.287400 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-c5472481-cfee-463b-82c2-b5ef2bb59856 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Image limits 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 17:16:48.287866 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-c5472481-cfee-463b-82c2-b5ef2bb59856 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Flavor pref 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 17:16:48.288264 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-c5472481-cfee-463b-82c2-b5ef2bb59856 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Image pref 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 17:16:48.288665 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-c5472481-cfee-463b-82c2-b5ef2bb59856 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 17:16:48.297579 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c5472481-cfee-463b-82c2-b5ef2bb59856 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:48.298019 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c5472481-cfee-463b-82c2-b5ef2bb59856 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:48.298835 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c5472481-cfee-463b-82c2-b5ef2bb59856 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:48.299263 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c5472481-cfee-463b-82c2-b5ef2bb59856 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:48.315871 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.quota [None req-c5472481-cfee-463b-82c2-b5ef2bb59856 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Getting quotas for project c7389bfa3cc94ec589f8f8f35ffb4d45. Resources: {'instances', 'cores', 'ram'} {{(pid=108418) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 17:16:48.319678 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.quota [None req-c5472481-cfee-463b-82c2-b5ef2bb59856 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Getting quotas for user 05218451c5d143c49765754f7981da14 and project c7389bfa3cc94ec589f8f8f35ffb4d45. Resources: {'instances', 'cores', 'ram'} {{(pid=108418) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 17:16:48.330056 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-c5472481-cfee-463b-82c2-b5ef2bb59856 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Going to run 1 instances... {{(pid=108418) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 17:16:48.332258 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-c5472481-cfee-463b-82c2-b5ef2bb59856 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] [instance: 0d7abbff-9981-4437-9714-db587662317f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22ce6e29-f3a7-49f0-b93a-ddbffa14e44e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108418) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 17:16:48.375945 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-c5472481-cfee-463b-82c2-b5ef2bb59856 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.478596 Sep 02 17:16:48.376569 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 643/1211] 10.222.0.41 () {60 vars in 1147 bytes} [Thu Sep 2 17:16:47 2021] POST /compute/v2.1/servers => generated 380 bytes in 480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 17:16:48.385929 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-c870250e-38c2-4006-91e6-3f1dea7ce46e tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:48.386540 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-c870250e-38c2-4006-91e6-3f1dea7ce46e tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] [instance: 0d7abbff-9981-4437-9714-db587662317f] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:48.439653 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-c870250e-38c2-4006-91e6-3f1dea7ce46e tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05218451c5d143c49765754f7981da14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7389bfa3cc94ec589f8f8f35ffb4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:48.446149 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-c870250e-38c2-4006-91e6-3f1dea7ce46e tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] 10.222.0.41 "GET /compute/v2.1/servers/0d7abbff-9981-4437-9714-db587662317f" status: 200 len: 1214 microversion: 2.1 time: 0.063763 Sep 02 17:16:48.446721 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 569/1212] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:48 2021] GET /compute/v2.1/servers/0d7abbff-9981-4437-9714-db587662317f => generated 1214 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:48.565505 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-621db5a3-ac0f-4294-a357-f3ccb4f91ee3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:48.566220 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-621db5a3-ac0f-4294-a357-f3ccb4f91ee3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:48.572359 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-621db5a3-ac0f-4294-a357-f3ccb4f91ee3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:48.572883 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-621db5a3-ac0f-4294-a357-f3ccb4f91ee3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:48.573663 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-621db5a3-ac0f-4294-a357-f3ccb4f91ee3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:48.574102 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-621db5a3-ac0f-4294-a357-f3ccb4f91ee3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:48.704297 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-621db5a3-ac0f-4294-a357-f3ccb4f91ee3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:48.712193 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-621db5a3-ac0f-4294-a357-f3ccb4f91ee3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1677 microversion: 2.1 time: 0.151113 Sep 02 17:16:48.713149 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 644/1213] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:48 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:49.462811 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-22b9a41a-f208-4a68-97c2-f30adf00199c tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:49.463427 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-22b9a41a-f208-4a68-97c2-f30adf00199c tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] [instance: 0d7abbff-9981-4437-9714-db587662317f] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:49.470208 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-22b9a41a-f208-4a68-97c2-f30adf00199c tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:49.470984 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-22b9a41a-f208-4a68-97c2-f30adf00199c tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:49.471921 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-22b9a41a-f208-4a68-97c2-f30adf00199c tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:49.472550 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-22b9a41a-f208-4a68-97c2-f30adf00199c tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:49.553512 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-22b9a41a-f208-4a68-97c2-f30adf00199c tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05218451c5d143c49765754f7981da14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7389bfa3cc94ec589f8f8f35ffb4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:49.560823 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-22b9a41a-f208-4a68-97c2-f30adf00199c tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] 10.222.0.41 "GET /compute/v2.1/servers/0d7abbff-9981-4437-9714-db587662317f" status: 200 len: 1284 microversion: 2.1 time: 0.101658 Sep 02 17:16:49.561383 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 570/1214] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:49 2021] GET /compute/v2.1/servers/0d7abbff-9981-4437-9714-db587662317f => generated 1284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:16:49.729088 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-261c613c-b7d8-455c-a037-0d252e876929 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:49.729622 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-261c613c-b7d8-455c-a037-0d252e876929 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:49.736580 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-261c613c-b7d8-455c-a037-0d252e876929 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:49.737060 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-261c613c-b7d8-455c-a037-0d252e876929 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:49.737828 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-261c613c-b7d8-455c-a037-0d252e876929 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:49.738261 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-261c613c-b7d8-455c-a037-0d252e876929 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:49.857791 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-261c613c-b7d8-455c-a037-0d252e876929 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:49.865496 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-261c613c-b7d8-455c-a037-0d252e876929 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1677 microversion: 2.1 time: 0.140131 Sep 02 17:16:49.866060 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 645/1215] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:49 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1677 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:50.577296 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-9a2403d5-d934-419d-b64e-3575a926b841 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:50.578437 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-9a2403d5-d934-419d-b64e-3575a926b841 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] [instance: 0d7abbff-9981-4437-9714-db587662317f] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:50.584264 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9a2403d5-d934-419d-b64e-3575a926b841 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:50.584707 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9a2403d5-d934-419d-b64e-3575a926b841 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:50.585466 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9a2403d5-d934-419d-b64e-3575a926b841 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:50.585892 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9a2403d5-d934-419d-b64e-3575a926b841 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:50.793843 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-271822e8-9116-4391-82c3-eb9da31dcb68 req-7229dbef-6793-4af4-8424-c42d01399d08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d7abbff-9981-4437-9714-db587662317f", "tag": "36fc5911-3a56-4b69-a028-81bf5ed07356"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:16:50.795804 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:16:50.795804 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:16:50.796640 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-9a2403d5-d934-419d-b64e-3575a926b841 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05218451c5d143c49765754f7981da14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7389bfa3cc94ec589f8f8f35ffb4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:50.805414 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-9a2403d5-d934-419d-b64e-3575a926b841 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] 10.222.0.41 "GET /compute/v2.1/servers/0d7abbff-9981-4437-9714-db587662317f" status: 200 len: 1314 microversion: 2.1 time: 0.231819 Sep 02 17:16:50.805748 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-271822e8-9116-4391-82c3-eb9da31dcb68 req-7229dbef-6793-4af4-8424-c42d01399d08 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:50.806206 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-271822e8-9116-4391-82c3-eb9da31dcb68 req-7229dbef-6793-4af4-8424-c42d01399d08 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:50.806598 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 571/1216] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:50 2021] GET /compute/v2.1/servers/0d7abbff-9981-4437-9714-db587662317f => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:50.818568 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-271822e8-9116-4391-82c3-eb9da31dcb68 req-7229dbef-6793-4af4-8424-c42d01399d08 service nova] Creating event network-changed:36fc5911-3a56-4b69-a028-81bf5ed07356 for instance 0d7abbff-9981-4437-9714-db587662317f on hv-cinder-80626 Sep 02 17:16:50.823700 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-271822e8-9116-4391-82c3-eb9da31dcb68 req-7229dbef-6793-4af4-8424-c42d01399d08 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033859 Sep 02 17:16:50.824474 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 646/1217] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:16:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:16:50.883536 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-e7db6750-74dd-482e-98f4-2292afde8109 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:50.884215 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-e7db6750-74dd-482e-98f4-2292afde8109 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:50.891135 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e7db6750-74dd-482e-98f4-2292afde8109 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:50.891544 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e7db6750-74dd-482e-98f4-2292afde8109 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:50.892327 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e7db6750-74dd-482e-98f4-2292afde8109 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:50.892763 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e7db6750-74dd-482e-98f4-2292afde8109 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:51.257336 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-e7db6750-74dd-482e-98f4-2292afde8109 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:51.264667 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-e7db6750-74dd-482e-98f4-2292afde8109 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1677 microversion: 2.1 time: 0.385037 Sep 02 17:16:51.265644 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 572/1218] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:50 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1677 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:51.823290 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-206abe22-6034-4534-af53-9c20f9093685 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:51.824026 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-206abe22-6034-4534-af53-9c20f9093685 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] [instance: 0d7abbff-9981-4437-9714-db587662317f] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:51.830251 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-206abe22-6034-4534-af53-9c20f9093685 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:51.830613 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-206abe22-6034-4534-af53-9c20f9093685 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:51.831407 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-206abe22-6034-4534-af53-9c20f9093685 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:51.831838 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-206abe22-6034-4534-af53-9c20f9093685 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:51.952009 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-206abe22-6034-4534-af53-9c20f9093685 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05218451c5d143c49765754f7981da14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7389bfa3cc94ec589f8f8f35ffb4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:51.960527 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-206abe22-6034-4534-af53-9c20f9093685 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] 10.222.0.41 "GET /compute/v2.1/servers/0d7abbff-9981-4437-9714-db587662317f" status: 200 len: 1314 microversion: 2.1 time: 0.141117 Sep 02 17:16:51.961126 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 647/1219] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:51 2021] GET /compute/v2.1/servers/0d7abbff-9981-4437-9714-db587662317f => generated 1314 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:52.280939 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-af5f0ce7-715d-4a0b-b247-1d55bd69c8b0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:52.282229 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-af5f0ce7-715d-4a0b-b247-1d55bd69c8b0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:52.287976 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-af5f0ce7-715d-4a0b-b247-1d55bd69c8b0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:52.288424 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-af5f0ce7-715d-4a0b-b247-1d55bd69c8b0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:52.289183 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-af5f0ce7-715d-4a0b-b247-1d55bd69c8b0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:52.289617 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-af5f0ce7-715d-4a0b-b247-1d55bd69c8b0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:52.405747 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-af5f0ce7-715d-4a0b-b247-1d55bd69c8b0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:52.413010 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-af5f0ce7-715d-4a0b-b247-1d55bd69c8b0 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1677 microversion: 2.1 time: 0.135673 Sep 02 17:16:52.413602 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 573/1220] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:52 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1677 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:52.977666 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-3bda83ad-0274-4ee6-acad-9d4ffdc8bab2 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:52.978282 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-3bda83ad-0274-4ee6-acad-9d4ffdc8bab2 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] [instance: 0d7abbff-9981-4437-9714-db587662317f] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:52.984646 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3bda83ad-0274-4ee6-acad-9d4ffdc8bab2 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:52.985094 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3bda83ad-0274-4ee6-acad-9d4ffdc8bab2 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:52.985961 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3bda83ad-0274-4ee6-acad-9d4ffdc8bab2 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:52.986398 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3bda83ad-0274-4ee6-acad-9d4ffdc8bab2 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:53.108830 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-3bda83ad-0274-4ee6-acad-9d4ffdc8bab2 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05218451c5d143c49765754f7981da14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7389bfa3cc94ec589f8f8f35ffb4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:53.117099 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-3bda83ad-0274-4ee6-acad-9d4ffdc8bab2 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] 10.222.0.41 "GET /compute/v2.1/servers/0d7abbff-9981-4437-9714-db587662317f" status: 200 len: 1314 microversion: 2.1 time: 0.142841 Sep 02 17:16:53.117649 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 648/1221] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:52 2021] GET /compute/v2.1/servers/0d7abbff-9981-4437-9714-db587662317f => generated 1314 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:53.429728 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-32b23571-8af4-4061-ba9b-e1ba33eca7be tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:53.430337 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-32b23571-8af4-4061-ba9b-e1ba33eca7be tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:53.436229 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-32b23571-8af4-4061-ba9b-e1ba33eca7be tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:53.436679 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-32b23571-8af4-4061-ba9b-e1ba33eca7be tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:53.437440 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-32b23571-8af4-4061-ba9b-e1ba33eca7be tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:53.437879 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-32b23571-8af4-4061-ba9b-e1ba33eca7be tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:53.552275 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-32b23571-8af4-4061-ba9b-e1ba33eca7be tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:53.559459 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-32b23571-8af4-4061-ba9b-e1ba33eca7be tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1677 microversion: 2.1 time: 0.133413 Sep 02 17:16:53.560022 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 574/1222] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:53 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1677 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:54.133482 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-1f512a97-3066-4248-80d0-87095e48e67a tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:54.134126 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-1f512a97-3066-4248-80d0-87095e48e67a tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] [instance: 0d7abbff-9981-4437-9714-db587662317f] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:54.139872 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1f512a97-3066-4248-80d0-87095e48e67a tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:54.140313 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1f512a97-3066-4248-80d0-87095e48e67a tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:54.141066 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1f512a97-3066-4248-80d0-87095e48e67a tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:54.141498 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1f512a97-3066-4248-80d0-87095e48e67a tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:54.262861 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-1f512a97-3066-4248-80d0-87095e48e67a tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05218451c5d143c49765754f7981da14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7389bfa3cc94ec589f8f8f35ffb4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:54.270040 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-1f512a97-3066-4248-80d0-87095e48e67a tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] 10.222.0.41 "GET /compute/v2.1/servers/0d7abbff-9981-4437-9714-db587662317f" status: 200 len: 1314 microversion: 2.1 time: 0.140214 Sep 02 17:16:54.270596 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 649/1223] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:54 2021] GET /compute/v2.1/servers/0d7abbff-9981-4437-9714-db587662317f => generated 1314 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:54.575930 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-03e9c4da-41b3-43be-b55d-f0fc4a4583d6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:54.576556 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-03e9c4da-41b3-43be-b55d-f0fc4a4583d6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:54.582400 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-03e9c4da-41b3-43be-b55d-f0fc4a4583d6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:54.582873 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-03e9c4da-41b3-43be-b55d-f0fc4a4583d6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:54.583642 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-03e9c4da-41b3-43be-b55d-f0fc4a4583d6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:54.584083 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-03e9c4da-41b3-43be-b55d-f0fc4a4583d6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:54.715650 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-03e9c4da-41b3-43be-b55d-f0fc4a4583d6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:54.723411 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-03e9c4da-41b3-43be-b55d-f0fc4a4583d6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1677 microversion: 2.1 time: 0.151119 Sep 02 17:16:54.723965 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 575/1224] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:54 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:55.286781 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-99ba933d-54a6-4b4e-be0b-a20807a66fec tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:55.287384 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-99ba933d-54a6-4b4e-be0b-a20807a66fec tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] [instance: 0d7abbff-9981-4437-9714-db587662317f] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:55.293107 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-99ba933d-54a6-4b4e-be0b-a20807a66fec tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:55.293546 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-99ba933d-54a6-4b4e-be0b-a20807a66fec tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:55.294293 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-99ba933d-54a6-4b4e-be0b-a20807a66fec tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:55.294920 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-99ba933d-54a6-4b4e-be0b-a20807a66fec tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:55.410364 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-99ba933d-54a6-4b4e-be0b-a20807a66fec tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05218451c5d143c49765754f7981da14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7389bfa3cc94ec589f8f8f35ffb4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:55.418562 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-99ba933d-54a6-4b4e-be0b-a20807a66fec tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] 10.222.0.41 "GET /compute/v2.1/servers/0d7abbff-9981-4437-9714-db587662317f" status: 200 len: 1314 microversion: 2.1 time: 0.135910 Sep 02 17:16:55.419166 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 650/1225] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:55 2021] GET /compute/v2.1/servers/0d7abbff-9981-4437-9714-db587662317f => generated 1314 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:55.740199 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-d4e981e9-ba27-4fc2-a191-4a79d3f08f53 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:55.740813 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-d4e981e9-ba27-4fc2-a191-4a79d3f08f53 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:55.747028 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d4e981e9-ba27-4fc2-a191-4a79d3f08f53 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:55.747473 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d4e981e9-ba27-4fc2-a191-4a79d3f08f53 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:55.748231 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d4e981e9-ba27-4fc2-a191-4a79d3f08f53 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:55.748664 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d4e981e9-ba27-4fc2-a191-4a79d3f08f53 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:55.865178 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-d4e981e9-ba27-4fc2-a191-4a79d3f08f53 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:55.872600 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-d4e981e9-ba27-4fc2-a191-4a79d3f08f53 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1654 microversion: 2.1 time: 0.136047 Sep 02 17:16:55.873154 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 576/1226] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:55 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1654 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:55.888350 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-ac9640fa-2b2f-427a-a228-ea78f449d707 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:16:55.894617 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ac9640fa-2b2f-427a-a228-ea78f449d707 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:55.895095 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ac9640fa-2b2f-427a-a228-ea78f449d707 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:55.916506 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-ac9640fa-2b2f-427a-a228-ea78f449d707 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Going to try to start instance {{(pid=108418) start /opt/stack/nova/nova/compute/api.py:2674}} Sep 02 17:16:55.955458 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-ac9640fa-2b2f-427a-a228-ea78f449d707 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action" status: 202 len: 0 microversion: 2.1 time: 0.070022 Sep 02 17:16:55.956062 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 651/1227] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:16:55 2021] POST /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/action => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:16:55.963873 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-9bd6742b-65e7-4819-8266-2663578310c6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:55.964480 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-9bd6742b-65e7-4819-8266-2663578310c6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:55.971283 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9bd6742b-65e7-4819-8266-2663578310c6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:55.971806 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9bd6742b-65e7-4819-8266-2663578310c6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:55.972659 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9bd6742b-65e7-4819-8266-2663578310c6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:55.973122 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9bd6742b-65e7-4819-8266-2663578310c6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:56.123723 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-9bd6742b-65e7-4819-8266-2663578310c6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:56.131709 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-9bd6742b-65e7-4819-8266-2663578310c6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1663 microversion: 2.1 time: 0.171426 Sep 02 17:16:56.132354 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 577/1228] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:55 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1663 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:56.435817 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-1cbe0eee-d7e1-45f6-aab4-278a800ce83e tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:56.436516 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-1cbe0eee-d7e1-45f6-aab4-278a800ce83e tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] [instance: 0d7abbff-9981-4437-9714-db587662317f] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:56.442489 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1cbe0eee-d7e1-45f6-aab4-278a800ce83e tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:56.442967 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1cbe0eee-d7e1-45f6-aab4-278a800ce83e tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:56.443726 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1cbe0eee-d7e1-45f6-aab4-278a800ce83e tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:56.444159 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1cbe0eee-d7e1-45f6-aab4-278a800ce83e tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:56.575796 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-1cbe0eee-d7e1-45f6-aab4-278a800ce83e tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05218451c5d143c49765754f7981da14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7389bfa3cc94ec589f8f8f35ffb4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:56.583701 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-1cbe0eee-d7e1-45f6-aab4-278a800ce83e tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] 10.222.0.41 "GET /compute/v2.1/servers/0d7abbff-9981-4437-9714-db587662317f" status: 200 len: 1314 microversion: 2.1 time: 0.151883 Sep 02 17:16:56.584716 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 652/1229] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:56 2021] GET /compute/v2.1/servers/0d7abbff-9981-4437-9714-db587662317f => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:56.609375 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [req-6a2cbdc0-e7b2-4b4f-bca7-ef62bafa9fdf req-4863a32e-aa9f-4fd5-a70f-6f2bce0dcc6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d7abbff-9981-4437-9714-db587662317f", "name": "network-vif-plugged", "status": "completed", "tag": "36fc5911-3a56-4b69-a028-81bf5ed07356"}]} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:16:56.611228 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:16:56.611228 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: warnings.warn(msg) Sep 02 17:16:56.619684 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-6a2cbdc0-e7b2-4b4f-bca7-ef62bafa9fdf req-4863a32e-aa9f-4fd5-a70f-6f2bce0dcc6e service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:56.620633 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-6a2cbdc0-e7b2-4b4f-bca7-ef62bafa9fdf req-4863a32e-aa9f-4fd5-a70f-6f2bce0dcc6e service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:56.634317 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.compute.server_external_events [req-6a2cbdc0-e7b2-4b4f-bca7-ef62bafa9fdf req-4863a32e-aa9f-4fd5-a70f-6f2bce0dcc6e service nova] Creating event network-vif-plugged:36fc5911-3a56-4b69-a028-81bf5ed07356 for instance 0d7abbff-9981-4437-9714-db587662317f on hv-cinder-80626 Sep 02 17:16:56.639035 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [req-6a2cbdc0-e7b2-4b4f-bca7-ef62bafa9fdf req-4863a32e-aa9f-4fd5-a70f-6f2bce0dcc6e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033735 Sep 02 17:16:56.639776 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 578/1230] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:16:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:16:57.148674 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-5b95d8ac-53b3-4d2c-a60f-6cb3a0f44e55 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:57.149221 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-5b95d8ac-53b3-4d2c-a60f-6cb3a0f44e55 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:57.155209 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5b95d8ac-53b3-4d2c-a60f-6cb3a0f44e55 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:57.155665 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5b95d8ac-53b3-4d2c-a60f-6cb3a0f44e55 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:57.156429 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5b95d8ac-53b3-4d2c-a60f-6cb3a0f44e55 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:57.156864 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5b95d8ac-53b3-4d2c-a60f-6cb3a0f44e55 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:57.275460 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-5b95d8ac-53b3-4d2c-a60f-6cb3a0f44e55 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:57.282576 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-5b95d8ac-53b3-4d2c-a60f-6cb3a0f44e55 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1663 microversion: 2.1 time: 0.137578 Sep 02 17:16:57.283157 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 653/1231] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:57 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1663 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:57.601176 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-0e0080a6-b249-4267-87d1-bb51d48d9f2e tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:57.601879 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-0e0080a6-b249-4267-87d1-bb51d48d9f2e tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] [instance: 0d7abbff-9981-4437-9714-db587662317f] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:57.607841 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0e0080a6-b249-4267-87d1-bb51d48d9f2e tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:57.608285 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0e0080a6-b249-4267-87d1-bb51d48d9f2e tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:57.609047 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0e0080a6-b249-4267-87d1-bb51d48d9f2e tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:57.609469 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0e0080a6-b249-4267-87d1-bb51d48d9f2e tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:57.729250 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-0e0080a6-b249-4267-87d1-bb51d48d9f2e tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05218451c5d143c49765754f7981da14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7389bfa3cc94ec589f8f8f35ffb4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:57.736996 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-0e0080a6-b249-4267-87d1-bb51d48d9f2e tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] 10.222.0.41 "GET /compute/v2.1/servers/0d7abbff-9981-4437-9714-db587662317f" status: 200 len: 1314 microversion: 2.1 time: 0.139786 Sep 02 17:16:57.737556 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 579/1232] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:57 2021] GET /compute/v2.1/servers/0d7abbff-9981-4437-9714-db587662317f => generated 1314 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:58.300219 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-bf9ceba9-daf4-4a38-8c61-f094e614baca tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:58.300833 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-bf9ceba9-daf4-4a38-8c61-f094e614baca tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:58.306680 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bf9ceba9-daf4-4a38-8c61-f094e614baca tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:58.307137 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bf9ceba9-daf4-4a38-8c61-f094e614baca tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:58.307901 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bf9ceba9-daf4-4a38-8c61-f094e614baca tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:58.308334 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bf9ceba9-daf4-4a38-8c61-f094e614baca tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:58.427829 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-bf9ceba9-daf4-4a38-8c61-f094e614baca tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:58.435141 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-bf9ceba9-daf4-4a38-8c61-f094e614baca tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1667 microversion: 2.1 time: 0.139120 Sep 02 17:16:58.435702 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 654/1233] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:58 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1667 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:58.753550 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-01de1dd0-a7dd-4793-a2e4-3fa0e8cbe70e tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:58.754078 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-01de1dd0-a7dd-4793-a2e4-3fa0e8cbe70e tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] [instance: 0d7abbff-9981-4437-9714-db587662317f] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:58.759875 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-01de1dd0-a7dd-4793-a2e4-3fa0e8cbe70e tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:58.760316 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-01de1dd0-a7dd-4793-a2e4-3fa0e8cbe70e tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:58.761062 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-01de1dd0-a7dd-4793-a2e4-3fa0e8cbe70e tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:58.761481 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-01de1dd0-a7dd-4793-a2e4-3fa0e8cbe70e tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:58.877590 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-01de1dd0-a7dd-4793-a2e4-3fa0e8cbe70e tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05218451c5d143c49765754f7981da14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7389bfa3cc94ec589f8f8f35ffb4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:58.884688 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-01de1dd0-a7dd-4793-a2e4-3fa0e8cbe70e tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] 10.222.0.41 "GET /compute/v2.1/servers/0d7abbff-9981-4437-9714-db587662317f" status: 200 len: 1498 microversion: 2.1 time: 0.134944 Sep 02 17:16:58.885240 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 580/1234] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:58 2021] GET /compute/v2.1/servers/0d7abbff-9981-4437-9714-db587662317f => generated 1498 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:16:59.403203 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-7f1d7b81-c3cd-4586-8f17-77689b825074 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:59.403779 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-7f1d7b81-c3cd-4586-8f17-77689b825074 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] [instance: 0d7abbff-9981-4437-9714-db587662317f] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:59.409368 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7f1d7b81-c3cd-4586-8f17-77689b825074 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:59.409795 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7f1d7b81-c3cd-4586-8f17-77689b825074 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:59.410538 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7f1d7b81-c3cd-4586-8f17-77689b825074 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:59.410989 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7f1d7b81-c3cd-4586-8f17-77689b825074 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:59.435192 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-7f1d7b81-c3cd-4586-8f17-77689b825074 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] [instance: 0d7abbff-9981-4437-9714-db587662317f] Going to try to terminate instance {{(pid=108418) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 17:16:59.505542 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-7f1d7b81-c3cd-4586-8f17-77689b825074 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] 10.222.0.41 "DELETE /compute/v2.1/servers/0d7abbff-9981-4437-9714-db587662317f" status: 204 len: 0 microversion: 2.1 time: 0.106139 Sep 02 17:16:59.506305 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 655/1235] 10.222.0.41 () {58 vars in 1239 bytes} [Thu Sep 2 17:16:59 2021] DELETE /compute/v2.1/servers/0d7abbff-9981-4437-9714-db587662317f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 17:16:59.515180 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-bf2d6e83-26f0-4c16-9f06-bd0fb9d47736 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:16:59.515786 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-bf2d6e83-26f0-4c16-9f06-bd0fb9d47736 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] [instance: 0d7abbff-9981-4437-9714-db587662317f] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:16:59.521464 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-bf2d6e83-26f0-4c16-9f06-bd0fb9d47736 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:59.521910 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-bf2d6e83-26f0-4c16-9f06-bd0fb9d47736 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:59.522685 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-bf2d6e83-26f0-4c16-9f06-bd0fb9d47736 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:16:59.523118 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-bf2d6e83-26f0-4c16-9f06-bd0fb9d47736 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:16:59.643368 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-bf2d6e83-26f0-4c16-9f06-bd0fb9d47736 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05218451c5d143c49765754f7981da14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7389bfa3cc94ec589f8f8f35ffb4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:16:59.650456 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-bf2d6e83-26f0-4c16-9f06-bd0fb9d47736 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] 10.222.0.41 "GET /compute/v2.1/servers/0d7abbff-9981-4437-9714-db587662317f" status: 200 len: 1504 microversion: 2.1 time: 0.139125 Sep 02 17:16:59.651049 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 581/1236] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:16:59 2021] GET /compute/v2.1/servers/0d7abbff-9981-4437-9714-db587662317f => generated 1504 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:00.668011 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-891ccdf2-1cbb-443e-807f-6744f8d99a11 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:00.668704 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-891ccdf2-1cbb-443e-807f-6744f8d99a11 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] [instance: 0d7abbff-9981-4437-9714-db587662317f] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:00.674763 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-891ccdf2-1cbb-443e-807f-6744f8d99a11 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:00.675206 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-891ccdf2-1cbb-443e-807f-6744f8d99a11 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:00.675963 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-891ccdf2-1cbb-443e-807f-6744f8d99a11 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:00.676385 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-891ccdf2-1cbb-443e-807f-6744f8d99a11 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:00.796065 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-891ccdf2-1cbb-443e-807f-6744f8d99a11 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05218451c5d143c49765754f7981da14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7389bfa3cc94ec589f8f8f35ffb4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:00.803211 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-891ccdf2-1cbb-443e-807f-6744f8d99a11 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] 10.222.0.41 "GET /compute/v2.1/servers/0d7abbff-9981-4437-9714-db587662317f" status: 200 len: 1504 microversion: 2.1 time: 0.139276 Sep 02 17:17:00.803797 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 656/1237] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:00 2021] GET /compute/v2.1/servers/0d7abbff-9981-4437-9714-db587662317f => generated 1504 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:01.591864 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [req-de7790a2-aeb0-40bf-9f31-55885639553d req-f282a0b4-97be-41e6-a350-d65d5fc94dce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d7abbff-9981-4437-9714-db587662317f", "name": "network-vif-deleted", "tag": "36fc5911-3a56-4b69-a028-81bf5ed07356"}]} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:17:01.593343 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:17:01.593343 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: warnings.warn(msg) Sep 02 17:17:01.600609 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-de7790a2-aeb0-40bf-9f31-55885639553d req-f282a0b4-97be-41e6-a350-d65d5fc94dce service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:01.601030 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-de7790a2-aeb0-40bf-9f31-55885639553d req-f282a0b4-97be-41e6-a350-d65d5fc94dce service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:01.612264 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.compute.server_external_events [req-de7790a2-aeb0-40bf-9f31-55885639553d req-f282a0b4-97be-41e6-a350-d65d5fc94dce service nova] Creating event network-vif-deleted:36fc5911-3a56-4b69-a028-81bf5ed07356 for instance 0d7abbff-9981-4437-9714-db587662317f on hv-cinder-80626 Sep 02 17:17:01.617308 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [req-de7790a2-aeb0-40bf-9f31-55885639553d req-f282a0b4-97be-41e6-a350-d65d5fc94dce service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028628 Sep 02 17:17:01.617990 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 582/1238] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:17:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:17:01.820103 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-bfc2ea90-ccd2-4199-a66c-7eeb9861ef56 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:01.820831 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-bfc2ea90-ccd2-4199-a66c-7eeb9861ef56 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] [instance: 0d7abbff-9981-4437-9714-db587662317f] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:01.826581 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bfc2ea90-ccd2-4199-a66c-7eeb9861ef56 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:01.827062 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bfc2ea90-ccd2-4199-a66c-7eeb9861ef56 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:01.827823 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bfc2ea90-ccd2-4199-a66c-7eeb9861ef56 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:01.828262 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bfc2ea90-ccd2-4199-a66c-7eeb9861ef56 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:01.858389 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bfc2ea90-ccd2-4199-a66c-7eeb9861ef56 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:01.858876 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-bfc2ea90-ccd2-4199-a66c-7eeb9861ef56 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:01.859328 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.objects.instance [None req-bfc2ea90-ccd2-4199-a66c-7eeb9861ef56 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lazy-loading 'fault' on Instance uuid 0d7abbff-9981-4437-9714-db587662317f {{(pid=108418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 17:17:01.897987 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-bfc2ea90-ccd2-4199-a66c-7eeb9861ef56 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05218451c5d143c49765754f7981da14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7389bfa3cc94ec589f8f8f35ffb4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:01.905038 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-bfc2ea90-ccd2-4199-a66c-7eeb9861ef56 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] 10.222.0.41 "GET /compute/v2.1/servers/0d7abbff-9981-4437-9714-db587662317f" status: 200 len: 1304 microversion: 2.1 time: 0.088581 Sep 02 17:17:01.905589 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 657/1239] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:01 2021] GET /compute/v2.1/servers/0d7abbff-9981-4437-9714-db587662317f => generated 1304 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:02.452833 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 17:17:02.453013 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: Thu Sep 2 17:17:02 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 02 17:17:02.921944 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-a202aaad-202c-48cb-9d82-82961dc8f7df tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:02.922784 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-a202aaad-202c-48cb-9d82-82961dc8f7df tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] [instance: 0d7abbff-9981-4437-9714-db587662317f] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:02.929088 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a202aaad-202c-48cb-9d82-82961dc8f7df tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:02.929533 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a202aaad-202c-48cb-9d82-82961dc8f7df tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:02.930482 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a202aaad-202c-48cb-9d82-82961dc8f7df tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:02.933620 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a202aaad-202c-48cb-9d82-82961dc8f7df tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:02.950051 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.wsgi [None req-a202aaad-202c-48cb-9d82-82961dc8f7df tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] HTTP exception thrown: Instance 0d7abbff-9981-4437-9714-db587662317f could not be found. Sep 02 17:17:02.950665 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-a202aaad-202c-48cb-9d82-82961dc8f7df tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Returning 404 to user: Instance 0d7abbff-9981-4437-9714-db587662317f could not be found. {{(pid=108417) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:17:02.951475 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-a202aaad-202c-48cb-9d82-82961dc8f7df tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] 10.222.0.41 "GET /compute/v2.1/servers/0d7abbff-9981-4437-9714-db587662317f" status: 404 len: 111 microversion: 2.1 time: 0.033779 Sep 02 17:17:02.952005 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 583/1240] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:02 2021] GET /compute/v2.1/servers/0d7abbff-9981-4437-9714-db587662317f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 17:17:02.997860 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-5849d7e8-29a1-458f-9c43-5e8dda0146f4 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-697481108", "imageRef": "22ce6e29-f3a7-49f0-b93a-ddbffa14e44e", "flavorRef": "452", "networks": [{"uuid": "9a4507ad-090b-4319-bc82-98ed0423ca3a"}]}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:17:03.051612 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.network.neutron [None req-5849d7e8-29a1-458f-9c43-5e8dda0146f4 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] validate_networks() for [('9a4507ad-090b-4319-bc82-98ed0423ca3a', None, None, None, None, None)] {{(pid=108418) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 17:17:03.377571 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-5849d7e8-29a1-458f-9c43-5e8dda0146f4 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Flavor limits 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 17:17:03.377994 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-5849d7e8-29a1-458f-9c43-5e8dda0146f4 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Image limits 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 17:17:03.378464 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-5849d7e8-29a1-458f-9c43-5e8dda0146f4 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Flavor pref 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 17:17:03.378907 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-5849d7e8-29a1-458f-9c43-5e8dda0146f4 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Image pref 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 17:17:03.379319 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-5849d7e8-29a1-458f-9c43-5e8dda0146f4 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 17:17:03.387743 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5849d7e8-29a1-458f-9c43-5e8dda0146f4 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:03.388187 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5849d7e8-29a1-458f-9c43-5e8dda0146f4 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:03.388975 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5849d7e8-29a1-458f-9c43-5e8dda0146f4 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:03.389411 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5849d7e8-29a1-458f-9c43-5e8dda0146f4 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:03.405840 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.quota [None req-5849d7e8-29a1-458f-9c43-5e8dda0146f4 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Getting quotas for project c7389bfa3cc94ec589f8f8f35ffb4d45. Resources: {'instances', 'cores', 'ram'} {{(pid=108418) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 17:17:03.409682 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.quota [None req-5849d7e8-29a1-458f-9c43-5e8dda0146f4 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Getting quotas for user 05218451c5d143c49765754f7981da14 and project c7389bfa3cc94ec589f8f8f35ffb4d45. Resources: {'instances', 'cores', 'ram'} {{(pid=108418) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 17:17:03.420223 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-5849d7e8-29a1-458f-9c43-5e8dda0146f4 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Going to run 1 instances... {{(pid=108418) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 17:17:03.422503 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-5849d7e8-29a1-458f-9c43-5e8dda0146f4 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] [instance: 79da4f4b-ebbf-4ebe-a633-0e800645d293] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22ce6e29-f3a7-49f0-b93a-ddbffa14e44e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108418) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 17:17:03.466738 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-5849d7e8-29a1-458f-9c43-5e8dda0146f4 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.472488 Sep 02 17:17:03.467378 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 658/1241] 10.222.0.41 () {60 vars in 1147 bytes} [Thu Sep 2 17:17:02 2021] POST /compute/v2.1/servers => generated 380 bytes in 474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 17:17:03.476964 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-0fe40865-22b8-42c2-9cf4-2c802cdd2352 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:03.477571 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-0fe40865-22b8-42c2-9cf4-2c802cdd2352 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] [instance: 79da4f4b-ebbf-4ebe-a633-0e800645d293] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:03.529715 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-0fe40865-22b8-42c2-9cf4-2c802cdd2352 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05218451c5d143c49765754f7981da14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7389bfa3cc94ec589f8f8f35ffb4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:03.537366 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-0fe40865-22b8-42c2-9cf4-2c802cdd2352 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] 10.222.0.41 "GET /compute/v2.1/servers/79da4f4b-ebbf-4ebe-a633-0e800645d293" status: 200 len: 1213 microversion: 2.1 time: 0.063935 Sep 02 17:17:03.537946 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 584/1242] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:03 2021] GET /compute/v2.1/servers/79da4f4b-ebbf-4ebe-a633-0e800645d293 => generated 1213 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:04.554361 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-4717605c-3eea-4d96-bd9e-bf2d76bf712a tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:04.555634 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-4717605c-3eea-4d96-bd9e-bf2d76bf712a tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] [instance: 79da4f4b-ebbf-4ebe-a633-0e800645d293] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:04.561501 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4717605c-3eea-4d96-bd9e-bf2d76bf712a tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:04.562204 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4717605c-3eea-4d96-bd9e-bf2d76bf712a tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:04.563006 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4717605c-3eea-4d96-bd9e-bf2d76bf712a tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:04.563447 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4717605c-3eea-4d96-bd9e-bf2d76bf712a tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:04.625609 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-4717605c-3eea-4d96-bd9e-bf2d76bf712a tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05218451c5d143c49765754f7981da14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7389bfa3cc94ec589f8f8f35ffb4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:04.633520 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-4717605c-3eea-4d96-bd9e-bf2d76bf712a tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] 10.222.0.41 "GET /compute/v2.1/servers/79da4f4b-ebbf-4ebe-a633-0e800645d293" status: 200 len: 1283 microversion: 2.1 time: 0.082784 Sep 02 17:17:04.636868 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 659/1243] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:04 2021] GET /compute/v2.1/servers/79da4f4b-ebbf-4ebe-a633-0e800645d293 => generated 1283 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:05.649879 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-f8da32d5-4412-4e98-a06d-a68a19759133 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:05.650499 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-f8da32d5-4412-4e98-a06d-a68a19759133 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] [instance: 79da4f4b-ebbf-4ebe-a633-0e800645d293] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:05.656261 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f8da32d5-4412-4e98-a06d-a68a19759133 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:05.656714 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f8da32d5-4412-4e98-a06d-a68a19759133 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:05.657476 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f8da32d5-4412-4e98-a06d-a68a19759133 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:05.657909 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f8da32d5-4412-4e98-a06d-a68a19759133 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:05.804904 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-7c337776-c06e-48e2-99a6-2050f87787b8 req-ea383051-905b-4240-b318-ce6b1e100b79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79da4f4b-ebbf-4ebe-a633-0e800645d293", "tag": "ae9068dc-71cd-4c1c-bf77-bdefd649e962"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:17:05.806696 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:17:05.806696 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:17:05.814081 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-7c337776-c06e-48e2-99a6-2050f87787b8 req-ea383051-905b-4240-b318-ce6b1e100b79 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:05.814524 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-7c337776-c06e-48e2-99a6-2050f87787b8 req-ea383051-905b-4240-b318-ce6b1e100b79 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:05.825353 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-7c337776-c06e-48e2-99a6-2050f87787b8 req-ea383051-905b-4240-b318-ce6b1e100b79 service nova] Creating event network-changed:ae9068dc-71cd-4c1c-bf77-bdefd649e962 for instance 79da4f4b-ebbf-4ebe-a633-0e800645d293 on hv-cinder-80626 Sep 02 17:17:05.830003 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-7c337776-c06e-48e2-99a6-2050f87787b8 req-ea383051-905b-4240-b318-ce6b1e100b79 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028737 Sep 02 17:17:05.830578 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 660/1244] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:17:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:17:05.851976 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-f8da32d5-4412-4e98-a06d-a68a19759133 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05218451c5d143c49765754f7981da14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7389bfa3cc94ec589f8f8f35ffb4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:05.859414 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-f8da32d5-4412-4e98-a06d-a68a19759133 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] 10.222.0.41 "GET /compute/v2.1/servers/79da4f4b-ebbf-4ebe-a633-0e800645d293" status: 200 len: 1313 microversion: 2.1 time: 0.213340 Sep 02 17:17:05.859959 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 585/1245] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:05 2021] GET /compute/v2.1/servers/79da4f4b-ebbf-4ebe-a633-0e800645d293 => generated 1313 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:06.877824 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-adc8be9a-5ce7-45d6-8b9a-e65e45e2a25f tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:06.878520 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-adc8be9a-5ce7-45d6-8b9a-e65e45e2a25f tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] [instance: 79da4f4b-ebbf-4ebe-a633-0e800645d293] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:06.884456 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-adc8be9a-5ce7-45d6-8b9a-e65e45e2a25f tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:06.884906 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-adc8be9a-5ce7-45d6-8b9a-e65e45e2a25f tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:06.885676 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-adc8be9a-5ce7-45d6-8b9a-e65e45e2a25f tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:06.886116 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-adc8be9a-5ce7-45d6-8b9a-e65e45e2a25f tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:07.013197 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-adc8be9a-5ce7-45d6-8b9a-e65e45e2a25f tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05218451c5d143c49765754f7981da14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7389bfa3cc94ec589f8f8f35ffb4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:07.020329 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-adc8be9a-5ce7-45d6-8b9a-e65e45e2a25f tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] 10.222.0.41 "GET /compute/v2.1/servers/79da4f4b-ebbf-4ebe-a633-0e800645d293" status: 200 len: 1313 microversion: 2.1 time: 0.147088 Sep 02 17:17:07.020888 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 661/1246] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:06 2021] GET /compute/v2.1/servers/79da4f4b-ebbf-4ebe-a633-0e800645d293 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:08.037390 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-0011d990-828b-4cf1-b5d4-23bc1c77fc56 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:08.038029 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-0011d990-828b-4cf1-b5d4-23bc1c77fc56 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] [instance: 79da4f4b-ebbf-4ebe-a633-0e800645d293] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:08.043788 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0011d990-828b-4cf1-b5d4-23bc1c77fc56 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:08.044237 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0011d990-828b-4cf1-b5d4-23bc1c77fc56 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:08.045000 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0011d990-828b-4cf1-b5d4-23bc1c77fc56 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:08.045432 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0011d990-828b-4cf1-b5d4-23bc1c77fc56 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:08.162549 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-0011d990-828b-4cf1-b5d4-23bc1c77fc56 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05218451c5d143c49765754f7981da14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7389bfa3cc94ec589f8f8f35ffb4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:08.170552 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-0011d990-828b-4cf1-b5d4-23bc1c77fc56 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] 10.222.0.41 "GET /compute/v2.1/servers/79da4f4b-ebbf-4ebe-a633-0e800645d293" status: 200 len: 1313 microversion: 2.1 time: 0.136898 Sep 02 17:17:08.171139 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 586/1247] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:08 2021] GET /compute/v2.1/servers/79da4f4b-ebbf-4ebe-a633-0e800645d293 => generated 1313 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:09.186793 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-3afdb379-d20b-4d51-9bdc-62ae050aaf49 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:09.187401 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-3afdb379-d20b-4d51-9bdc-62ae050aaf49 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] [instance: 79da4f4b-ebbf-4ebe-a633-0e800645d293] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:09.193175 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3afdb379-d20b-4d51-9bdc-62ae050aaf49 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:09.193622 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3afdb379-d20b-4d51-9bdc-62ae050aaf49 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:09.194378 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3afdb379-d20b-4d51-9bdc-62ae050aaf49 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:09.194837 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-3afdb379-d20b-4d51-9bdc-62ae050aaf49 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:09.314060 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-3afdb379-d20b-4d51-9bdc-62ae050aaf49 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05218451c5d143c49765754f7981da14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7389bfa3cc94ec589f8f8f35ffb4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:09.321466 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-3afdb379-d20b-4d51-9bdc-62ae050aaf49 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] 10.222.0.41 "GET /compute/v2.1/servers/79da4f4b-ebbf-4ebe-a633-0e800645d293" status: 200 len: 1313 microversion: 2.1 time: 0.138329 Sep 02 17:17:09.322023 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 662/1248] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:09 2021] GET /compute/v2.1/servers/79da4f4b-ebbf-4ebe-a633-0e800645d293 => generated 1313 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:10.338359 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-f4a6a0a3-3dd1-4bbb-9f17-f1fa6fd7db38 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:10.338994 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-f4a6a0a3-3dd1-4bbb-9f17-f1fa6fd7db38 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] [instance: 79da4f4b-ebbf-4ebe-a633-0e800645d293] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:10.349556 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f4a6a0a3-3dd1-4bbb-9f17-f1fa6fd7db38 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:10.350004 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f4a6a0a3-3dd1-4bbb-9f17-f1fa6fd7db38 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:10.350809 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f4a6a0a3-3dd1-4bbb-9f17-f1fa6fd7db38 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:10.351239 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f4a6a0a3-3dd1-4bbb-9f17-f1fa6fd7db38 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:10.469301 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-f4a6a0a3-3dd1-4bbb-9f17-f1fa6fd7db38 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05218451c5d143c49765754f7981da14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7389bfa3cc94ec589f8f8f35ffb4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:10.476395 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-f4a6a0a3-3dd1-4bbb-9f17-f1fa6fd7db38 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] 10.222.0.41 "GET /compute/v2.1/servers/79da4f4b-ebbf-4ebe-a633-0e800645d293" status: 200 len: 1313 microversion: 2.1 time: 0.141720 Sep 02 17:17:10.476946 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 587/1249] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:10 2021] GET /compute/v2.1/servers/79da4f4b-ebbf-4ebe-a633-0e800645d293 => generated 1313 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:10.666184 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-d1fac9bf-40f2-4f5f-b741-9230e89f73db req-2fbf385f-ded3-4d5c-84d5-fc1f3420956e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79da4f4b-ebbf-4ebe-a633-0e800645d293", "name": "network-vif-plugged", "status": "completed", "tag": "ae9068dc-71cd-4c1c-bf77-bdefd649e962"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:17:10.667709 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:17:10.667709 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:17:10.674991 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-d1fac9bf-40f2-4f5f-b741-9230e89f73db req-2fbf385f-ded3-4d5c-84d5-fc1f3420956e service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:10.675425 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-d1fac9bf-40f2-4f5f-b741-9230e89f73db req-2fbf385f-ded3-4d5c-84d5-fc1f3420956e service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:10.687821 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-d1fac9bf-40f2-4f5f-b741-9230e89f73db req-2fbf385f-ded3-4d5c-84d5-fc1f3420956e service nova] Creating event network-vif-plugged:ae9068dc-71cd-4c1c-bf77-bdefd649e962 for instance 79da4f4b-ebbf-4ebe-a633-0e800645d293 on hv-cinder-80626 Sep 02 17:17:10.693332 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-d1fac9bf-40f2-4f5f-b741-9230e89f73db req-2fbf385f-ded3-4d5c-84d5-fc1f3420956e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030768 Sep 02 17:17:10.694287 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 663/1250] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:17:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:17:11.493187 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-edbf72ab-bf3a-44b0-b6b3-c5b44525a712 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:11.493742 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-edbf72ab-bf3a-44b0-b6b3-c5b44525a712 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] [instance: 79da4f4b-ebbf-4ebe-a633-0e800645d293] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:11.499660 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-edbf72ab-bf3a-44b0-b6b3-c5b44525a712 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:11.500101 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-edbf72ab-bf3a-44b0-b6b3-c5b44525a712 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:11.500857 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-edbf72ab-bf3a-44b0-b6b3-c5b44525a712 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:11.501285 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-edbf72ab-bf3a-44b0-b6b3-c5b44525a712 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:11.617917 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-edbf72ab-bf3a-44b0-b6b3-c5b44525a712 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05218451c5d143c49765754f7981da14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7389bfa3cc94ec589f8f8f35ffb4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:11.625102 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-edbf72ab-bf3a-44b0-b6b3-c5b44525a712 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] 10.222.0.41 "GET /compute/v2.1/servers/79da4f4b-ebbf-4ebe-a633-0e800645d293" status: 200 len: 1313 microversion: 2.1 time: 0.135864 Sep 02 17:17:11.625653 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 588/1251] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:11 2021] GET /compute/v2.1/servers/79da4f4b-ebbf-4ebe-a633-0e800645d293 => generated 1313 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:12.642435 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-f0c0f186-8601-4ff3-bd35-424bbaa217c0 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:12.643138 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-f0c0f186-8601-4ff3-bd35-424bbaa217c0 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] [instance: 79da4f4b-ebbf-4ebe-a633-0e800645d293] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:12.649161 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f0c0f186-8601-4ff3-bd35-424bbaa217c0 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:12.649603 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f0c0f186-8601-4ff3-bd35-424bbaa217c0 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:12.650351 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f0c0f186-8601-4ff3-bd35-424bbaa217c0 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:12.650808 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f0c0f186-8601-4ff3-bd35-424bbaa217c0 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:12.773315 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-f0c0f186-8601-4ff3-bd35-424bbaa217c0 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05218451c5d143c49765754f7981da14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7389bfa3cc94ec589f8f8f35ffb4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:12.780593 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-f0c0f186-8601-4ff3-bd35-424bbaa217c0 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] 10.222.0.41 "GET /compute/v2.1/servers/79da4f4b-ebbf-4ebe-a633-0e800645d293" status: 200 len: 1497 microversion: 2.1 time: 0.142719 Sep 02 17:17:12.781140 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 664/1252] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:12 2021] GET /compute/v2.1/servers/79da4f4b-ebbf-4ebe-a633-0e800645d293 => generated 1497 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:13.416333 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-0f79313b-00bb-4930-b460-ba646448130c tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:13.416815 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-0f79313b-00bb-4930-b460-ba646448130c tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] [instance: 79da4f4b-ebbf-4ebe-a633-0e800645d293] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:13.422527 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0f79313b-00bb-4930-b460-ba646448130c tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:13.423657 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0f79313b-00bb-4930-b460-ba646448130c tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:13.424405 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0f79313b-00bb-4930-b460-ba646448130c tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:13.424828 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0f79313b-00bb-4930-b460-ba646448130c tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:13.448023 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-0f79313b-00bb-4930-b460-ba646448130c tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] [instance: 79da4f4b-ebbf-4ebe-a633-0e800645d293] Going to try to terminate instance {{(pid=108417) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 17:17:13.518226 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-0f79313b-00bb-4930-b460-ba646448130c tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] 10.222.0.41 "DELETE /compute/v2.1/servers/79da4f4b-ebbf-4ebe-a633-0e800645d293" status: 204 len: 0 microversion: 2.1 time: 0.105226 Sep 02 17:17:13.518897 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 589/1253] 10.222.0.41 () {58 vars in 1239 bytes} [Thu Sep 2 17:17:13 2021] DELETE /compute/v2.1/servers/79da4f4b-ebbf-4ebe-a633-0e800645d293 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 17:17:13.526991 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-ca89eb78-f67e-4f10-b4cf-70cb84f5c9a8 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:13.527589 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-ca89eb78-f67e-4f10-b4cf-70cb84f5c9a8 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] [instance: 79da4f4b-ebbf-4ebe-a633-0e800645d293] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:13.533971 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ca89eb78-f67e-4f10-b4cf-70cb84f5c9a8 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:13.534449 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ca89eb78-f67e-4f10-b4cf-70cb84f5c9a8 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:13.535228 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ca89eb78-f67e-4f10-b4cf-70cb84f5c9a8 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:13.535651 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ca89eb78-f67e-4f10-b4cf-70cb84f5c9a8 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:13.650737 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-ca89eb78-f67e-4f10-b4cf-70cb84f5c9a8 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05218451c5d143c49765754f7981da14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7389bfa3cc94ec589f8f8f35ffb4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:13.658421 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-ca89eb78-f67e-4f10-b4cf-70cb84f5c9a8 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] 10.222.0.41 "GET /compute/v2.1/servers/79da4f4b-ebbf-4ebe-a633-0e800645d293" status: 200 len: 1503 microversion: 2.1 time: 0.135231 Sep 02 17:17:13.659002 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 665/1254] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:13 2021] GET /compute/v2.1/servers/79da4f4b-ebbf-4ebe-a633-0e800645d293 => generated 1503 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:14.675926 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-d8bb8278-e6db-41d7-9356-8938e4164bfc tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:14.676636 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-d8bb8278-e6db-41d7-9356-8938e4164bfc tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] [instance: 79da4f4b-ebbf-4ebe-a633-0e800645d293] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:14.682514 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d8bb8278-e6db-41d7-9356-8938e4164bfc tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:14.682989 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d8bb8278-e6db-41d7-9356-8938e4164bfc tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:14.683751 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d8bb8278-e6db-41d7-9356-8938e4164bfc tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:14.684181 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d8bb8278-e6db-41d7-9356-8938e4164bfc tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:14.803046 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-d8bb8278-e6db-41d7-9356-8938e4164bfc tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05218451c5d143c49765754f7981da14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7389bfa3cc94ec589f8f8f35ffb4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:14.810255 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-d8bb8278-e6db-41d7-9356-8938e4164bfc tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] 10.222.0.41 "GET /compute/v2.1/servers/79da4f4b-ebbf-4ebe-a633-0e800645d293" status: 200 len: 1503 microversion: 2.1 time: 0.138478 Sep 02 17:17:14.810840 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 590/1255] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:14 2021] GET /compute/v2.1/servers/79da4f4b-ebbf-4ebe-a633-0e800645d293 => generated 1503 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:15.629149 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-ce7b7437-8b60-4afd-8ddf-596ee97e15ff req-87308a60-02ae-47b7-ac1e-439027d6fdbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79da4f4b-ebbf-4ebe-a633-0e800645d293", "name": "network-vif-deleted", "tag": "ae9068dc-71cd-4c1c-bf77-bdefd649e962"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:17:15.630656 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:17:15.630656 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:17:15.637492 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-ce7b7437-8b60-4afd-8ddf-596ee97e15ff req-87308a60-02ae-47b7-ac1e-439027d6fdbd service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:15.637939 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-ce7b7437-8b60-4afd-8ddf-596ee97e15ff req-87308a60-02ae-47b7-ac1e-439027d6fdbd service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:15.649431 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-ce7b7437-8b60-4afd-8ddf-596ee97e15ff req-87308a60-02ae-47b7-ac1e-439027d6fdbd service nova] Creating event network-vif-deleted:ae9068dc-71cd-4c1c-bf77-bdefd649e962 for instance 79da4f4b-ebbf-4ebe-a633-0e800645d293 on hv-cinder-80626 Sep 02 17:17:15.654154 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-ce7b7437-8b60-4afd-8ddf-596ee97e15ff req-87308a60-02ae-47b7-ac1e-439027d6fdbd service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029104 Sep 02 17:17:15.654760 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 666/1256] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:17:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:17:15.827432 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-46b2a1d5-5905-40b8-9b27-fb57cefca149 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:15.827982 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-46b2a1d5-5905-40b8-9b27-fb57cefca149 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] [instance: 79da4f4b-ebbf-4ebe-a633-0e800645d293] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:15.834328 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-46b2a1d5-5905-40b8-9b27-fb57cefca149 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:15.834815 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-46b2a1d5-5905-40b8-9b27-fb57cefca149 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:15.835578 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-46b2a1d5-5905-40b8-9b27-fb57cefca149 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:15.836008 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-46b2a1d5-5905-40b8-9b27-fb57cefca149 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:15.865048 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-46b2a1d5-5905-40b8-9b27-fb57cefca149 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:15.865498 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-46b2a1d5-5905-40b8-9b27-fb57cefca149 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:15.865940 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.objects.instance [None req-46b2a1d5-5905-40b8-9b27-fb57cefca149 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lazy-loading 'fault' on Instance uuid 79da4f4b-ebbf-4ebe-a633-0e800645d293 {{(pid=108417) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 17:17:15.904190 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-46b2a1d5-5905-40b8-9b27-fb57cefca149 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '05218451c5d143c49765754f7981da14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7389bfa3cc94ec589f8f8f35ffb4d45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:15.911324 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-46b2a1d5-5905-40b8-9b27-fb57cefca149 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] 10.222.0.41 "GET /compute/v2.1/servers/79da4f4b-ebbf-4ebe-a633-0e800645d293" status: 200 len: 1303 microversion: 2.1 time: 0.087713 Sep 02 17:17:15.911876 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 591/1257] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:15 2021] GET /compute/v2.1/servers/79da4f4b-ebbf-4ebe-a633-0e800645d293 => generated 1303 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:16.930038 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-91379894-4a28-4e57-858b-9af1346ad141 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:16.930834 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-91379894-4a28-4e57-858b-9af1346ad141 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] [instance: 79da4f4b-ebbf-4ebe-a633-0e800645d293] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:16.936863 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-91379894-4a28-4e57-858b-9af1346ad141 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:16.937314 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-91379894-4a28-4e57-858b-9af1346ad141 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:16.938079 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-91379894-4a28-4e57-858b-9af1346ad141 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:16.939084 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-91379894-4a28-4e57-858b-9af1346ad141 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:16.951857 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.wsgi [None req-91379894-4a28-4e57-858b-9af1346ad141 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] HTTP exception thrown: Instance 79da4f4b-ebbf-4ebe-a633-0e800645d293 could not be found. Sep 02 17:17:16.952430 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-91379894-4a28-4e57-858b-9af1346ad141 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] Returning 404 to user: Instance 79da4f4b-ebbf-4ebe-a633-0e800645d293 could not be found. {{(pid=108418) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:17:16.953321 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-91379894-4a28-4e57-858b-9af1346ad141 tempest-VolumesActionsTest-1368974452 tempest-VolumesActionsTest-1368974452-project] 10.222.0.41 "GET /compute/v2.1/servers/79da4f4b-ebbf-4ebe-a633-0e800645d293" status: 404 len: 111 microversion: 2.1 time: 0.027406 Sep 02 17:17:16.953831 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 667/1258] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:16 2021] GET /compute/v2.1/servers/79da4f4b-ebbf-4ebe-a633-0e800645d293 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 17:17:28.091328 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-225b422a-5f58-4087-a108-c87590401f83 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-126784821", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1934407481", "security_groups": [{"name": "tempest-secgroup-smoke-1772581189"}], "block_device_mapping_v2": [{"uuid": "0798843a-3b99-4eae-8682-b71280069753", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ade5891d-380a-4e81-9169-bebc402fc3c9"}]}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:17:28.212809 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.network.neutron [None req-225b422a-5f58-4087-a108-c87590401f83 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] validate_networks() for [('ade5891d-380a-4e81-9169-bebc402fc3c9', None, None, None, None, None)] {{(pid=108417) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 17:17:28.652177 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-225b422a-5f58-4087-a108-c87590401f83 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Flavor limits 0:0:0 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 17:17:28.652710 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-225b422a-5f58-4087-a108-c87590401f83 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Image limits 0:0:0 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 17:17:28.653216 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-225b422a-5f58-4087-a108-c87590401f83 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Flavor pref 0:0:0 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 17:17:28.653627 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-225b422a-5f58-4087-a108-c87590401f83 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Image pref 0:0:0 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 17:17:28.654041 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.virt.hardware [None req-225b422a-5f58-4087-a108-c87590401f83 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108417) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 17:17:28.665011 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-225b422a-5f58-4087-a108-c87590401f83 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:28.665837 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-225b422a-5f58-4087-a108-c87590401f83 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:28.666968 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-225b422a-5f58-4087-a108-c87590401f83 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:28.667809 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-225b422a-5f58-4087-a108-c87590401f83 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:28.687320 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.quota [None req-225b422a-5f58-4087-a108-c87590401f83 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Getting quotas for project dc090408372e41379709e2067823b1a6. Resources: {'instances', 'cores', 'ram'} {{(pid=108417) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 17:17:28.691879 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.quota [None req-225b422a-5f58-4087-a108-c87590401f83 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Getting quotas for user 6df6e202f8b64bb0b33226402b65adaf and project dc090408372e41379709e2067823b1a6. Resources: {'instances', 'cores', 'ram'} {{(pid=108417) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 17:17:28.770017 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-225b422a-5f58-4087-a108-c87590401f83 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Going to run 1 instances... {{(pid=108417) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 17:17:28.772678 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-225b422a-5f58-4087-a108-c87590401f83 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 5f2982c3-a18d-44c5-96be-3752f9d9a195] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0798843a-3b99-4eae-8682-b71280069753',volume_size=None,volume_type=None)] {{(pid=108417) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 17:17:28.944433 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-225b422a-5f58-4087-a108-c87590401f83 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.856528 Sep 02 17:17:28.950041 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 592/1259] 10.222.0.41 () {60 vars in 1147 bytes} [Thu Sep 2 17:17:28 2021] POST /compute/v2.1/servers => generated 406 bytes in 858 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 17:17:28.956607 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-94eab120-0781-4101-8e44-959fbe26746b tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:28.957526 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-94eab120-0781-4101-8e44-959fbe26746b tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 5f2982c3-a18d-44c5-96be-3752f9d9a195] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:29.018694 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-94eab120-0781-4101-8e44-959fbe26746b tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:29.026113 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-94eab120-0781-4101-8e44-959fbe26746b tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195" status: 200 len: 1094 microversion: 2.1 time: 0.074323 Sep 02 17:17:29.028029 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 668/1260] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:28 2021] GET /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195 => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:30.042940 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-5ba211ad-8ad7-4916-b5e7-dd220f4a8b16 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:30.043549 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-5ba211ad-8ad7-4916-b5e7-dd220f4a8b16 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 5f2982c3-a18d-44c5-96be-3752f9d9a195] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:30.051656 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5ba211ad-8ad7-4916-b5e7-dd220f4a8b16 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:30.052363 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5ba211ad-8ad7-4916-b5e7-dd220f4a8b16 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:30.053299 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5ba211ad-8ad7-4916-b5e7-dd220f4a8b16 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:30.053885 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5ba211ad-8ad7-4916-b5e7-dd220f4a8b16 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:30.443256 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-5ba211ad-8ad7-4916-b5e7-dd220f4a8b16 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:30.451244 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-5ba211ad-8ad7-4916-b5e7-dd220f4a8b16 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195" status: 200 len: 1200 microversion: 2.1 time: 0.412074 Sep 02 17:17:30.451799 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 593/1261] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:30 2021] GET /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195 => generated 1200 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:31.468458 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-b50a6a2a-ed0f-473f-9f85-c1362e522bb6 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:31.470284 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-b50a6a2a-ed0f-473f-9f85-c1362e522bb6 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 5f2982c3-a18d-44c5-96be-3752f9d9a195] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:31.497040 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b50a6a2a-ed0f-473f-9f85-c1362e522bb6 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:31.498808 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b50a6a2a-ed0f-473f-9f85-c1362e522bb6 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:31.500582 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b50a6a2a-ed0f-473f-9f85-c1362e522bb6 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:31.501868 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b50a6a2a-ed0f-473f-9f85-c1362e522bb6 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:31.677477 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-b50a6a2a-ed0f-473f-9f85-c1362e522bb6 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:31.687990 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-b50a6a2a-ed0f-473f-9f85-c1362e522bb6 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195" status: 200 len: 1266 microversion: 2.1 time: 0.223246 Sep 02 17:17:31.689240 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 669/1262] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:31 2021] GET /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:32.067249 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [req-7ae96234-d416-41a1-8402-000c5fcc89f6 req-6e009980-6f8d-4a12-a68b-d9812617dc61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f2982c3-a18d-44c5-96be-3752f9d9a195", "tag": "702539df-f620-4be7-9e22-1b97e1bb4dbe"}]} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:17:32.070338 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:17:32.070338 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: warnings.warn(msg) Sep 02 17:17:32.081399 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-7ae96234-d416-41a1-8402-000c5fcc89f6 req-6e009980-6f8d-4a12-a68b-d9812617dc61 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:32.082300 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-7ae96234-d416-41a1-8402-000c5fcc89f6 req-6e009980-6f8d-4a12-a68b-d9812617dc61 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:32.100006 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.compute.server_external_events [req-7ae96234-d416-41a1-8402-000c5fcc89f6 req-6e009980-6f8d-4a12-a68b-d9812617dc61 service nova] Creating event network-changed:702539df-f620-4be7-9e22-1b97e1bb4dbe for instance 5f2982c3-a18d-44c5-96be-3752f9d9a195 on hv-cinder-80626 Sep 02 17:17:32.105175 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [req-7ae96234-d416-41a1-8402-000c5fcc89f6 req-6e009980-6f8d-4a12-a68b-d9812617dc61 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042140 Sep 02 17:17:32.111396 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 594/1263] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:17:32 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:17:32.705849 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-b104206b-c11d-4182-a5e0-64784a235eeb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:32.706753 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-b104206b-c11d-4182-a5e0-64784a235eeb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 5f2982c3-a18d-44c5-96be-3752f9d9a195] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:32.712937 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b104206b-c11d-4182-a5e0-64784a235eeb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:32.713703 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b104206b-c11d-4182-a5e0-64784a235eeb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:32.714733 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b104206b-c11d-4182-a5e0-64784a235eeb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:32.715405 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-b104206b-c11d-4182-a5e0-64784a235eeb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:32.851408 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-b104206b-c11d-4182-a5e0-64784a235eeb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:32.860508 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-b104206b-c11d-4182-a5e0-64784a235eeb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195" status: 200 len: 1266 microversion: 2.1 time: 0.158275 Sep 02 17:17:32.862107 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 670/1264] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:32 2021] GET /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:33.881267 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-7362765c-328f-4548-8cb2-79c4e32b8731 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:33.883361 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-7362765c-328f-4548-8cb2-79c4e32b8731 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 5f2982c3-a18d-44c5-96be-3752f9d9a195] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:33.891848 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7362765c-328f-4548-8cb2-79c4e32b8731 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:33.892670 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7362765c-328f-4548-8cb2-79c4e32b8731 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:33.893645 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7362765c-328f-4548-8cb2-79c4e32b8731 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:33.894140 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7362765c-328f-4548-8cb2-79c4e32b8731 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:34.046960 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-7362765c-328f-4548-8cb2-79c4e32b8731 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:34.055338 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-7362765c-328f-4548-8cb2-79c4e32b8731 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195" status: 200 len: 1266 microversion: 2.1 time: 0.180598 Sep 02 17:17:34.056447 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 595/1265] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:33 2021] GET /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:35.072634 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-c7c30146-5800-41dc-9f10-376986a7f7ce tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:35.073346 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-c7c30146-5800-41dc-9f10-376986a7f7ce tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 5f2982c3-a18d-44c5-96be-3752f9d9a195] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:35.080174 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c7c30146-5800-41dc-9f10-376986a7f7ce tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:35.080775 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c7c30146-5800-41dc-9f10-376986a7f7ce tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:35.081648 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c7c30146-5800-41dc-9f10-376986a7f7ce tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:35.082261 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c7c30146-5800-41dc-9f10-376986a7f7ce tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:35.217276 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-c7c30146-5800-41dc-9f10-376986a7f7ce tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:35.234018 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-c7c30146-5800-41dc-9f10-376986a7f7ce tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195" status: 200 len: 1266 microversion: 2.1 time: 0.165123 Sep 02 17:17:35.245071 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 671/1266] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:35 2021] GET /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:36.254413 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-ef8a12d4-e75a-40a9-a1c7-8c47ccdc5061 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:36.255639 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-ef8a12d4-e75a-40a9-a1c7-8c47ccdc5061 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 5f2982c3-a18d-44c5-96be-3752f9d9a195] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:36.261873 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ef8a12d4-e75a-40a9-a1c7-8c47ccdc5061 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:36.262517 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ef8a12d4-e75a-40a9-a1c7-8c47ccdc5061 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:36.263488 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ef8a12d4-e75a-40a9-a1c7-8c47ccdc5061 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:36.263937 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ef8a12d4-e75a-40a9-a1c7-8c47ccdc5061 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:36.397621 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-ef8a12d4-e75a-40a9-a1c7-8c47ccdc5061 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:36.406526 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-ef8a12d4-e75a-40a9-a1c7-8c47ccdc5061 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195" status: 200 len: 1266 microversion: 2.1 time: 0.156324 Sep 02 17:17:36.407769 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 596/1267] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:36 2021] GET /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:37.423379 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-54133e03-99e1-4f7e-9527-d13414dee44f tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:37.424838 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-54133e03-99e1-4f7e-9527-d13414dee44f tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 5f2982c3-a18d-44c5-96be-3752f9d9a195] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:37.431563 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-54133e03-99e1-4f7e-9527-d13414dee44f tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:37.432252 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-54133e03-99e1-4f7e-9527-d13414dee44f tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:37.433237 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-54133e03-99e1-4f7e-9527-d13414dee44f tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:37.433865 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-54133e03-99e1-4f7e-9527-d13414dee44f tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:37.561921 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-54133e03-99e1-4f7e-9527-d13414dee44f tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:37.570716 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-54133e03-99e1-4f7e-9527-d13414dee44f tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195" status: 200 len: 1266 microversion: 2.1 time: 0.151094 Sep 02 17:17:37.580891 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 672/1268] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:37 2021] GET /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:38.088011 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-ba618d42-df19-4e4a-bcfd-c79f14f254ba tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:38.098017 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-ba618d42-df19-4e4a-bcfd-c79f14f254ba tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:38.104098 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ba618d42-df19-4e4a-bcfd-c79f14f254ba tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:38.104772 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ba618d42-df19-4e4a-bcfd-c79f14f254ba tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:38.105858 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ba618d42-df19-4e4a-bcfd-c79f14f254ba tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:38.106487 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ba618d42-df19-4e4a-bcfd-c79f14f254ba tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:38.142418 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-ba618d42-df19-4e4a-bcfd-c79f14f254ba tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058135 Sep 02 17:17:38.143305 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 597/1269] 10.222.0.41 () {58 vars in 1302 bytes} [Thu Sep 2 17:17:38 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 17:17:38.213817 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-81c8eed6-5495-4b9b-83e6-0901d51c4154 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:38.214308 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-81c8eed6-5495-4b9b-83e6-0901d51c4154 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:38.221396 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-81c8eed6-5495-4b9b-83e6-0901d51c4154 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:38.222033 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-81c8eed6-5495-4b9b-83e6-0901d51c4154 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:38.223046 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-81c8eed6-5495-4b9b-83e6-0901d51c4154 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:38.223634 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-81c8eed6-5495-4b9b-83e6-0901d51c4154 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:38.253542 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-81c8eed6-5495-4b9b-83e6-0901d51c4154 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Going to try to terminate instance {{(pid=108418) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 17:17:38.342314 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-81c8eed6-5495-4b9b-83e6-0901d51c4154 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "DELETE /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 204 len: 0 microversion: 2.1 time: 0.131970 Sep 02 17:17:38.346706 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 673/1270] 10.222.0.41 () {58 vars in 1239 bytes} [Thu Sep 2 17:17:38 2021] DELETE /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 17:17:38.353908 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-8cecee28-99b8-4312-8acb-907e71739a38 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:38.354991 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-8cecee28-99b8-4312-8acb-907e71739a38 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:38.363272 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8cecee28-99b8-4312-8acb-907e71739a38 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:38.364185 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8cecee28-99b8-4312-8acb-907e71739a38 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:38.365076 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8cecee28-99b8-4312-8acb-907e71739a38 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:38.365647 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8cecee28-99b8-4312-8acb-907e71739a38 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:38.503915 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-8cecee28-99b8-4312-8acb-907e71739a38 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:38.511696 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-8cecee28-99b8-4312-8acb-907e71739a38 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1673 microversion: 2.1 time: 0.161816 Sep 02 17:17:38.512295 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 598/1271] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:38 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:38.588932 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-de352d1e-b810-41aa-aa09-5ae26a8b9d98 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:38.589671 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-de352d1e-b810-41aa-aa09-5ae26a8b9d98 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 5f2982c3-a18d-44c5-96be-3752f9d9a195] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:38.596621 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-de352d1e-b810-41aa-aa09-5ae26a8b9d98 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:38.596989 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-de352d1e-b810-41aa-aa09-5ae26a8b9d98 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:38.597778 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-de352d1e-b810-41aa-aa09-5ae26a8b9d98 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:38.598214 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-de352d1e-b810-41aa-aa09-5ae26a8b9d98 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:38.747533 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-de352d1e-b810-41aa-aa09-5ae26a8b9d98 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:38.755299 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-de352d1e-b810-41aa-aa09-5ae26a8b9d98 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195" status: 200 len: 1266 microversion: 2.1 time: 0.170407 Sep 02 17:17:38.756155 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 674/1272] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:38 2021] GET /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:39.528934 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-bd652f1a-a6e5-47a6-9fbc-89d5b63266b6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:39.529537 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-bd652f1a-a6e5-47a6-9fbc-89d5b63266b6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:39.536140 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-bd652f1a-a6e5-47a6-9fbc-89d5b63266b6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:39.536607 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-bd652f1a-a6e5-47a6-9fbc-89d5b63266b6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:39.537382 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-bd652f1a-a6e5-47a6-9fbc-89d5b63266b6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:39.537816 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-bd652f1a-a6e5-47a6-9fbc-89d5b63266b6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:39.657048 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-bd652f1a-a6e5-47a6-9fbc-89d5b63266b6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:39.664230 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-bd652f1a-a6e5-47a6-9fbc-89d5b63266b6 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1673 microversion: 2.1 time: 0.138879 Sep 02 17:17:39.664788 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 599/1273] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:39 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1673 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:39.772301 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-ad85e69c-fc64-4863-8499-3f1923c53234 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:39.772818 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-ad85e69c-fc64-4863-8499-3f1923c53234 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 5f2982c3-a18d-44c5-96be-3752f9d9a195] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:39.778517 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ad85e69c-fc64-4863-8499-3f1923c53234 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:39.778997 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ad85e69c-fc64-4863-8499-3f1923c53234 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:39.779761 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ad85e69c-fc64-4863-8499-3f1923c53234 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:39.780194 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ad85e69c-fc64-4863-8499-3f1923c53234 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:39.903057 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-ad85e69c-fc64-4863-8499-3f1923c53234 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:39.910378 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-ad85e69c-fc64-4863-8499-3f1923c53234 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195" status: 200 len: 1266 microversion: 2.1 time: 0.141860 Sep 02 17:17:39.911117 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 675/1274] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:39 2021] GET /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:40.586136 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [req-67b4da8b-7b10-460f-b7e0-addec0797c81 req-ece7af2e-5b50-4c24-a3b2-e76c1bf68e27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77697955-515d-4f49-8b5e-8d01b670ff58", "name": "network-vif-deleted", "tag": "d6ce6dfa-70c0-4097-860a-9fdc1e531848"}]} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:17:40.587645 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:17:40.587645 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: warnings.warn(msg) Sep 02 17:17:40.595356 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-67b4da8b-7b10-460f-b7e0-addec0797c81 req-ece7af2e-5b50-4c24-a3b2-e76c1bf68e27 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:40.595991 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-67b4da8b-7b10-460f-b7e0-addec0797c81 req-ece7af2e-5b50-4c24-a3b2-e76c1bf68e27 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:40.608531 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.compute.server_external_events [req-67b4da8b-7b10-460f-b7e0-addec0797c81 req-ece7af2e-5b50-4c24-a3b2-e76c1bf68e27 service nova] Creating event network-vif-deleted:d6ce6dfa-70c0-4097-860a-9fdc1e531848 for instance 77697955-515d-4f49-8b5e-8d01b670ff58 on hv-cinder-80626 Sep 02 17:17:40.615134 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [req-67b4da8b-7b10-460f-b7e0-addec0797c81 req-ece7af2e-5b50-4c24-a3b2-e76c1bf68e27 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032322 Sep 02 17:17:40.615751 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 600/1275] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:17:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:17:40.681249 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-4a76a87e-efca-469f-9f57-05ee96ca4dd5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:40.682090 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-4a76a87e-efca-469f-9f57-05ee96ca4dd5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:40.690961 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4a76a87e-efca-469f-9f57-05ee96ca4dd5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:40.695456 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4a76a87e-efca-469f-9f57-05ee96ca4dd5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:40.696667 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4a76a87e-efca-469f-9f57-05ee96ca4dd5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:40.697315 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4a76a87e-efca-469f-9f57-05ee96ca4dd5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:40.743659 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4a76a87e-efca-469f-9f57-05ee96ca4dd5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:40.744571 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-4a76a87e-efca-469f-9f57-05ee96ca4dd5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:40.745211 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.objects.instance [None req-4a76a87e-efca-469f-9f57-05ee96ca4dd5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lazy-loading 'fault' on Instance uuid 77697955-515d-4f49-8b5e-8d01b670ff58 {{(pid=108418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 17:17:40.805899 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-4a76a87e-efca-469f-9f57-05ee96ca4dd5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:40.816170 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-4a76a87e-efca-469f-9f57-05ee96ca4dd5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 200 len: 1328 microversion: 2.1 time: 0.138813 Sep 02 17:17:40.819469 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 676/1276] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:40 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 1328 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:40.928434 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-b3571ad7-1b6c-4d4e-89a2-b4a9d879eb36 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:40.929124 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-b3571ad7-1b6c-4d4e-89a2-b4a9d879eb36 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 5f2982c3-a18d-44c5-96be-3752f9d9a195] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:40.935377 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b3571ad7-1b6c-4d4e-89a2-b4a9d879eb36 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:40.935810 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b3571ad7-1b6c-4d4e-89a2-b4a9d879eb36 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:40.936564 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b3571ad7-1b6c-4d4e-89a2-b4a9d879eb36 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:40.936987 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b3571ad7-1b6c-4d4e-89a2-b4a9d879eb36 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:41.073361 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-b3571ad7-1b6c-4d4e-89a2-b4a9d879eb36 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:41.084204 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-b3571ad7-1b6c-4d4e-89a2-b4a9d879eb36 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195" status: 200 len: 1266 microversion: 2.1 time: 0.160380 Sep 02 17:17:41.084773 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 601/1277] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:40 2021] GET /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:41.835043 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-e7bca759-eed2-434c-96c0-7c5a038ee71a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:41.835659 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-e7bca759-eed2-434c-96c0-7c5a038ee71a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:41.841604 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e7bca759-eed2-434c-96c0-7c5a038ee71a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:41.842111 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e7bca759-eed2-434c-96c0-7c5a038ee71a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:41.842895 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e7bca759-eed2-434c-96c0-7c5a038ee71a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:41.843330 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e7bca759-eed2-434c-96c0-7c5a038ee71a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:41.857083 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.wsgi [None req-e7bca759-eed2-434c-96c0-7c5a038ee71a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] HTTP exception thrown: Instance 77697955-515d-4f49-8b5e-8d01b670ff58 could not be found. Sep 02 17:17:41.857679 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-e7bca759-eed2-434c-96c0-7c5a038ee71a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Returning 404 to user: Instance 77697955-515d-4f49-8b5e-8d01b670ff58 could not be found. {{(pid=108418) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:17:41.858510 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-e7bca759-eed2-434c-96c0-7c5a038ee71a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 404 len: 111 microversion: 2.1 time: 0.027179 Sep 02 17:17:41.859147 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 677/1278] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:41 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 17:17:41.867971 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-bbe2651c-588d-495b-a4be-f9d16900b1af tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '.version_select at 0x7fca984b23a0>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:41.885311 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-bbe2651c-588d-495b-a4be-f9d16900b1af tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2038002381" status: 202 len: 0 microversion: 2.1 time: 0.021126 Sep 02 17:17:41.885869 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 602/1279] 10.222.0.41 () {58 vars in 1221 bytes} [Thu Sep 2 17:17:41 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2038002381 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:17:42.101079 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-f1086789-9327-4cb1-b154-15b8690bd0cf tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:42.101691 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-f1086789-9327-4cb1-b154-15b8690bd0cf tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 5f2982c3-a18d-44c5-96be-3752f9d9a195] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:42.107466 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f1086789-9327-4cb1-b154-15b8690bd0cf tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:42.107916 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f1086789-9327-4cb1-b154-15b8690bd0cf tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:42.108715 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f1086789-9327-4cb1-b154-15b8690bd0cf tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:42.109153 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f1086789-9327-4cb1-b154-15b8690bd0cf tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:42.307647 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-f1086789-9327-4cb1-b154-15b8690bd0cf tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:42.315781 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-f1086789-9327-4cb1-b154-15b8690bd0cf tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195" status: 200 len: 1266 microversion: 2.1 time: 0.218339 Sep 02 17:17:42.316555 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 678/1280] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:42 2021] GET /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:42.660350 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-404a934a-12b8-47e5-a3f4-780db263d13e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'create', calling method: .version_select at 0x7fca9849a940>, body: {"keypair": {"name": "tempest-keypair-999501011"}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:17:42.677268 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.quota [None req-404a934a-12b8-47e5-a3f4-780db263d13e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Getting quotas for project efb6337b5a3548bcad9fd236c619842d. Resources: {'key_pairs'} {{(pid=108417) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 17:17:42.681065 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.quota [None req-404a934a-12b8-47e5-a3f4-780db263d13e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Getting quotas for user f9a77763fb724542a66e1d5f79f630f5 and project efb6337b5a3548bcad9fd236c619842d. Resources: {'key_pairs'} {{(pid=108417) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 17:17:42.950266 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-f57df72e-d572-41c0-a98f-2c06e6a2c799 req-68f44d11-d912-4fee-9976-3ec8d403f2bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f2982c3-a18d-44c5-96be-3752f9d9a195", "name": "network-vif-plugged", "status": "completed", "tag": "702539df-f620-4be7-9e22-1b97e1bb4dbe"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:17:42.951778 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:17:42.951778 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:17:42.962409 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-f57df72e-d572-41c0-a98f-2c06e6a2c799 req-68f44d11-d912-4fee-9976-3ec8d403f2bb service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:42.963072 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-f57df72e-d572-41c0-a98f-2c06e6a2c799 req-68f44d11-d912-4fee-9976-3ec8d403f2bb service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:42.976354 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-f57df72e-d572-41c0-a98f-2c06e6a2c799 req-68f44d11-d912-4fee-9976-3ec8d403f2bb service nova] Creating event network-vif-plugged:702539df-f620-4be7-9e22-1b97e1bb4dbe for instance 5f2982c3-a18d-44c5-96be-3752f9d9a195 on hv-cinder-80626 Sep 02 17:17:42.981563 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-f57df72e-d572-41c0-a98f-2c06e6a2c799 req-68f44d11-d912-4fee-9976-3ec8d403f2bb service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034788 Sep 02 17:17:42.982605 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 679/1281] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:17:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:17:43.196348 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.quota [None req-404a934a-12b8-47e5-a3f4-780db263d13e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Getting quotas for project efb6337b5a3548bcad9fd236c619842d. Resources: {'key_pairs'} {{(pid=108417) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 17:17:43.200111 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.quota [None req-404a934a-12b8-47e5-a3f4-780db263d13e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Getting quotas for user f9a77763fb724542a66e1d5f79f630f5 and project efb6337b5a3548bcad9fd236c619842d. Resources: {'key_pairs'} {{(pid=108417) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 17:17:43.214597 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-404a934a-12b8-47e5-a3f4-780db263d13e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.559660 Sep 02 17:17:43.215709 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 603/1282] 10.222.0.41 () {60 vars in 1158 bytes} [Thu Sep 2 17:17:42 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:43.333920 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-89458341-2d65-4281-8f7a-446ee9388acb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:43.334639 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-89458341-2d65-4281-8f7a-446ee9388acb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 5f2982c3-a18d-44c5-96be-3752f9d9a195] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:43.340655 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-89458341-2d65-4281-8f7a-446ee9388acb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:43.341092 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-89458341-2d65-4281-8f7a-446ee9388acb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:43.341863 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-89458341-2d65-4281-8f7a-446ee9388acb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:43.342296 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-89458341-2d65-4281-8f7a-446ee9388acb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:43.481425 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-89458341-2d65-4281-8f7a-446ee9388acb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:43.491712 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-89458341-2d65-4281-8f7a-446ee9388acb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195" status: 200 len: 1266 microversion: 2.1 time: 0.161987 Sep 02 17:17:43.493152 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 680/1283] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:43 2021] GET /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:44.511674 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-c7881fc0-40b2-419a-bef2-bdc22d4e7126 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:44.513480 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-c7881fc0-40b2-419a-bef2-bdc22d4e7126 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 5f2982c3-a18d-44c5-96be-3752f9d9a195] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:44.522075 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c7881fc0-40b2-419a-bef2-bdc22d4e7126 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:44.523244 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c7881fc0-40b2-419a-bef2-bdc22d4e7126 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:44.524305 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c7881fc0-40b2-419a-bef2-bdc22d4e7126 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:44.525033 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c7881fc0-40b2-419a-bef2-bdc22d4e7126 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:44.781520 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-c7881fc0-40b2-419a-bef2-bdc22d4e7126 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:44.792468 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-c7881fc0-40b2-419a-bef2-bdc22d4e7126 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195" status: 200 len: 1266 microversion: 2.1 time: 0.283473 Sep 02 17:17:44.793273 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 604/1284] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:44 2021] GET /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195 => generated 1266 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:44.880778 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-382ef831-9a8b-4782-89e1-605d39e34b8a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-914105066", "imageRef": "22ce6e29-f3a7-49f0-b93a-ddbffa14e44e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cb42942f-ef9a-49eb-b2f9-e00e0bd8f527"}], "security_groups": [{"name": "tempest-securitygroup--871767198"}], "key_name": "tempest-keypair-999501011", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:17:45.075900 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.network.neutron [None req-382ef831-9a8b-4782-89e1-605d39e34b8a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] validate_networks() for [('cb42942f-ef9a-49eb-b2f9-e00e0bd8f527', None, None, None, None, None)] {{(pid=108418) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 17:17:45.745768 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-382ef831-9a8b-4782-89e1-605d39e34b8a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Flavor limits 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 17:17:45.746190 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-382ef831-9a8b-4782-89e1-605d39e34b8a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Image limits 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 17:17:45.746688 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-382ef831-9a8b-4782-89e1-605d39e34b8a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Flavor pref 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 17:17:45.747108 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-382ef831-9a8b-4782-89e1-605d39e34b8a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Image pref 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 17:17:45.747520 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-382ef831-9a8b-4782-89e1-605d39e34b8a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 17:17:45.759727 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-382ef831-9a8b-4782-89e1-605d39e34b8a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:45.760182 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-382ef831-9a8b-4782-89e1-605d39e34b8a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:45.761171 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-382ef831-9a8b-4782-89e1-605d39e34b8a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:45.761688 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-382ef831-9a8b-4782-89e1-605d39e34b8a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:45.779481 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.quota [None req-382ef831-9a8b-4782-89e1-605d39e34b8a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Getting quotas for project efb6337b5a3548bcad9fd236c619842d. Resources: {'instances', 'cores', 'ram'} {{(pid=108418) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 17:17:45.784407 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.quota [None req-382ef831-9a8b-4782-89e1-605d39e34b8a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Getting quotas for user f9a77763fb724542a66e1d5f79f630f5 and project efb6337b5a3548bcad9fd236c619842d. Resources: {'instances', 'cores', 'ram'} {{(pid=108418) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 17:17:45.797290 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-382ef831-9a8b-4782-89e1-605d39e34b8a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Going to run 1 instances... {{(pid=108418) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 17:17:45.800425 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-382ef831-9a8b-4782-89e1-605d39e34b8a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='22ce6e29-f3a7-49f0-b93a-ddbffa14e44e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108418) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 17:17:45.847404 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-382ef831-9a8b-4782-89e1-605d39e34b8a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.970541 Sep 02 17:17:45.848630 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 681/1285] 10.222.0.41 () {60 vars in 1147 bytes} [Thu Sep 2 17:17:44 2021] POST /compute/v2.1/servers => generated 401 bytes in 973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 17:17:45.858783 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-f29b591f-4d34-47cc-b2b7-4f91bc666db5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:45.860592 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-f29b591f-4d34-47cc-b2b7-4f91bc666db5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:45.869324 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-da531d87-129b-496a-bf79-a7f36b9e0980 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:45.869944 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-da531d87-129b-496a-bf79-a7f36b9e0980 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 5f2982c3-a18d-44c5-96be-3752f9d9a195] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:45.878507 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-da531d87-129b-496a-bf79-a7f36b9e0980 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:45.879070 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-da531d87-129b-496a-bf79-a7f36b9e0980 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:45.879763 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-da531d87-129b-496a-bf79-a7f36b9e0980 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:45.880198 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-da531d87-129b-496a-bf79-a7f36b9e0980 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:45.947056 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-f29b591f-4d34-47cc-b2b7-4f91bc666db5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:45.957101 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-f29b591f-4d34-47cc-b2b7-4f91bc666db5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8" status: 200 len: 1236 microversion: 2.1 time: 0.102171 Sep 02 17:17:45.958052 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 605/1286] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:45 2021] GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8 => generated 1236 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:46.149566 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-da531d87-129b-496a-bf79-a7f36b9e0980 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:46.157700 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-da531d87-129b-496a-bf79-a7f36b9e0980 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195" status: 200 len: 1451 microversion: 2.1 time: 0.292252 Sep 02 17:17:46.159102 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 682/1287] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:45 2021] GET /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195 => generated 1451 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:17:46.174889 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-fd407d2f-3364-4eed-89bb-6c7da8317cfb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:46.175760 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-fd407d2f-3364-4eed-89bb-6c7da8317cfb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 5f2982c3-a18d-44c5-96be-3752f9d9a195] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:46.181595 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fd407d2f-3364-4eed-89bb-6c7da8317cfb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:46.181996 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fd407d2f-3364-4eed-89bb-6c7da8317cfb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:46.182977 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fd407d2f-3364-4eed-89bb-6c7da8317cfb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:46.183575 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fd407d2f-3364-4eed-89bb-6c7da8317cfb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:46.318435 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-fd407d2f-3364-4eed-89bb-6c7da8317cfb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:46.326044 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-fd407d2f-3364-4eed-89bb-6c7da8317cfb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195" status: 200 len: 1451 microversion: 2.1 time: 0.155280 Sep 02 17:17:46.326870 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 606/1288] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:46 2021] GET /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:46.973965 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-ca151e42-7a51-4ead-894e-62bd8a72c498 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:46.974735 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-ca151e42-7a51-4ead-894e-62bd8a72c498 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:46.981039 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ca151e42-7a51-4ead-894e-62bd8a72c498 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:46.981613 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ca151e42-7a51-4ead-894e-62bd8a72c498 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:46.982740 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ca151e42-7a51-4ead-894e-62bd8a72c498 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:46.983398 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ca151e42-7a51-4ead-894e-62bd8a72c498 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:47.077520 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-ca151e42-7a51-4ead-894e-62bd8a72c498 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:47.086811 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-ca151e42-7a51-4ead-894e-62bd8a72c498 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8" status: 200 len: 1296 microversion: 2.1 time: 0.117277 Sep 02 17:17:47.097729 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 683/1289] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:46 2021] GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8 => generated 1296 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:48.103549 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-320783b2-c426-491a-8175-58204b37fb9f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:48.104173 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-320783b2-c426-491a-8175-58204b37fb9f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:48.121274 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-320783b2-c426-491a-8175-58204b37fb9f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:48.121724 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-320783b2-c426-491a-8175-58204b37fb9f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:48.122517 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-320783b2-c426-491a-8175-58204b37fb9f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:48.123007 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-320783b2-c426-491a-8175-58204b37fb9f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:48.214434 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-320783b2-c426-491a-8175-58204b37fb9f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:48.223616 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-320783b2-c426-491a-8175-58204b37fb9f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8" status: 200 len: 1294 microversion: 2.1 time: 0.123676 Sep 02 17:17:48.224494 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 607/1290] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:48 2021] GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8 => generated 1294 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:49.240618 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-22c82ec4-cb5a-4f38-a866-69304524287a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:49.241225 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-22c82ec4-cb5a-4f38-a866-69304524287a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:49.254405 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-22c82ec4-cb5a-4f38-a866-69304524287a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:49.254886 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-22c82ec4-cb5a-4f38-a866-69304524287a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:49.255667 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-22c82ec4-cb5a-4f38-a866-69304524287a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:49.256106 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-22c82ec4-cb5a-4f38-a866-69304524287a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:49.397765 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [req-50386765-b18a-491f-b272-24cd373b19e5 req-06e98d30-1934-4223-b2c6-a174c0b1dae0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f2982c3-a18d-44c5-96be-3752f9d9a195", "tag": "702539df-f620-4be7-9e22-1b97e1bb4dbe"}]} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:17:49.397765 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:17:49.397765 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: warnings.warn(msg) Sep 02 17:17:49.403888 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-50386765-b18a-491f-b272-24cd373b19e5 req-06e98d30-1934-4223-b2c6-a174c0b1dae0 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:49.404201 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-50386765-b18a-491f-b272-24cd373b19e5 req-06e98d30-1934-4223-b2c6-a174c0b1dae0 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:49.429607 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.compute.server_external_events [req-50386765-b18a-491f-b272-24cd373b19e5 req-06e98d30-1934-4223-b2c6-a174c0b1dae0 service nova] Creating event network-changed:702539df-f620-4be7-9e22-1b97e1bb4dbe for instance 5f2982c3-a18d-44c5-96be-3752f9d9a195 on hv-cinder-80626 Sep 02 17:17:49.435556 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [req-50386765-b18a-491f-b272-24cd373b19e5 req-06e98d30-1934-4223-b2c6-a174c0b1dae0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046265 Sep 02 17:17:49.436154 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 608/1291] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:17:49 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:17:49.504385 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-22c82ec4-cb5a-4f38-a866-69304524287a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:49.514309 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-22c82ec4-cb5a-4f38-a866-69304524287a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8" status: 200 len: 1361 microversion: 2.1 time: 0.277225 Sep 02 17:17:49.521028 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 684/1292] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:49 2021] GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8 => generated 1361 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:50.535736 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-9939d4ed-4a20-4f18-aa04-e619ae364a53 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:50.536433 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-9939d4ed-4a20-4f18-aa04-e619ae364a53 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:50.549747 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9939d4ed-4a20-4f18-aa04-e619ae364a53 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:50.550097 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9939d4ed-4a20-4f18-aa04-e619ae364a53 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:50.551042 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9939d4ed-4a20-4f18-aa04-e619ae364a53 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:50.551491 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9939d4ed-4a20-4f18-aa04-e619ae364a53 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:50.804995 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-9939d4ed-4a20-4f18-aa04-e619ae364a53 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:50.816132 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-9939d4ed-4a20-4f18-aa04-e619ae364a53 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8" status: 200 len: 1361 microversion: 2.1 time: 0.284050 Sep 02 17:17:50.817376 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 609/1293] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:50 2021] GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8 => generated 1361 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:51.454510 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-5d71c8f3-5927-48bf-a635-32d2526bfdf0 req-02995944-2dce-4a67-958f-3676e247f4ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea9c64d9-b562-4bb6-88a2-88434835b7c8", "tag": "3425a5d0-ec45-4ecb-8ce4-10ea503dba12"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:17:51.456795 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:17:51.456795 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:17:51.464970 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-5d71c8f3-5927-48bf-a635-32d2526bfdf0 req-02995944-2dce-4a67-958f-3676e247f4ea service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:51.465706 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-5d71c8f3-5927-48bf-a635-32d2526bfdf0 req-02995944-2dce-4a67-958f-3676e247f4ea service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:51.478331 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-5d71c8f3-5927-48bf-a635-32d2526bfdf0 req-02995944-2dce-4a67-958f-3676e247f4ea service nova] Creating event network-changed:3425a5d0-ec45-4ecb-8ce4-10ea503dba12 for instance ea9c64d9-b562-4bb6-88a2-88434835b7c8 on hv-cinder-80626 Sep 02 17:17:51.483998 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-5d71c8f3-5927-48bf-a635-32d2526bfdf0 req-02995944-2dce-4a67-958f-3676e247f4ea service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034969 Sep 02 17:17:51.485539 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 685/1294] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:17:51 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:17:51.836789 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-22f89ed6-a566-4ddf-840c-56ece55afc8c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:51.838086 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-22f89ed6-a566-4ddf-840c-56ece55afc8c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:51.848514 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-22f89ed6-a566-4ddf-840c-56ece55afc8c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:51.852375 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-22f89ed6-a566-4ddf-840c-56ece55afc8c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:51.853399 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-22f89ed6-a566-4ddf-840c-56ece55afc8c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:51.857855 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-22f89ed6-a566-4ddf-840c-56ece55afc8c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:52.021327 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-22f89ed6-a566-4ddf-840c-56ece55afc8c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:52.030301 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-22f89ed6-a566-4ddf-840c-56ece55afc8c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8" status: 200 len: 1361 microversion: 2.1 time: 0.200180 Sep 02 17:17:52.044183 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 610/1295] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:51 2021] GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8 => generated 1361 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:53.048459 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-5ef8bc94-068e-4f37-9a8b-cc54791da132 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:53.049173 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-5ef8bc94-068e-4f37-9a8b-cc54791da132 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:53.055597 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5ef8bc94-068e-4f37-9a8b-cc54791da132 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:53.056161 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5ef8bc94-068e-4f37-9a8b-cc54791da132 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:53.056955 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5ef8bc94-068e-4f37-9a8b-cc54791da132 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:53.057546 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-5ef8bc94-068e-4f37-9a8b-cc54791da132 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:53.340762 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-5ef8bc94-068e-4f37-9a8b-cc54791da132 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:53.361288 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-5ef8bc94-068e-4f37-9a8b-cc54791da132 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8" status: 200 len: 1361 microversion: 2.1 time: 0.316668 Sep 02 17:17:53.373988 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 686/1296] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:53 2021] GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8 => generated 1361 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:54.379000 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-39cc2d6d-75ce-400b-a1a5-b15df72e5efd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:54.380252 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-39cc2d6d-75ce-400b-a1a5-b15df72e5efd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:54.386233 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-39cc2d6d-75ce-400b-a1a5-b15df72e5efd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:54.386952 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-39cc2d6d-75ce-400b-a1a5-b15df72e5efd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:54.388073 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-39cc2d6d-75ce-400b-a1a5-b15df72e5efd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:54.388676 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-39cc2d6d-75ce-400b-a1a5-b15df72e5efd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:54.650734 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-a9cc0efd-da1b-4011-a4ab-a329d8181786 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:54.651885 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-a9cc0efd-da1b-4011-a4ab-a329d8181786 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:54.661933 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a9cc0efd-da1b-4011-a4ab-a329d8181786 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:54.662708 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a9cc0efd-da1b-4011-a4ab-a329d8181786 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:54.663753 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a9cc0efd-da1b-4011-a4ab-a329d8181786 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:54.666593 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a9cc0efd-da1b-4011-a4ab-a329d8181786 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:54.679332 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-39cc2d6d-75ce-400b-a1a5-b15df72e5efd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:54.688737 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-39cc2d6d-75ce-400b-a1a5-b15df72e5efd tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8" status: 200 len: 1361 microversion: 2.1 time: 0.313309 Sep 02 17:17:54.696395 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 611/1297] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:54 2021] GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8 => generated 1361 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:54.701101 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [req-5ecb58f6-ebc7-4c60-9d6b-b39915cdb4d9 req-30e45df6-7824-44fe-a2df-f0f79f144084 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cea6ec2a-41c7-41c5-8471-3da2ba130315", "tag": "f0347608-2078-4ebd-b282-53b22f166ac6"}]} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:17:54.706947 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:17:54.706947 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: warnings.warn(msg) Sep 02 17:17:54.714718 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-a9cc0efd-da1b-4011-a4ab-a329d8181786 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Going to try to terminate instance {{(pid=108418) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 17:17:54.714959 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-5ecb58f6-ebc7-4c60-9d6b-b39915cdb4d9 req-30e45df6-7824-44fe-a2df-f0f79f144084 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:54.715619 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-5ecb58f6-ebc7-4c60-9d6b-b39915cdb4d9 req-30e45df6-7824-44fe-a2df-f0f79f144084 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:54.727149 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.compute.server_external_events [req-5ecb58f6-ebc7-4c60-9d6b-b39915cdb4d9 req-30e45df6-7824-44fe-a2df-f0f79f144084 service nova] Creating event network-changed:f0347608-2078-4ebd-b282-53b22f166ac6 for instance cea6ec2a-41c7-41c5-8471-3da2ba130315 on hv-cinder-80626 Sep 02 17:17:54.734339 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [req-5ecb58f6-ebc7-4c60-9d6b-b39915cdb4d9 req-30e45df6-7824-44fe-a2df-f0f79f144084 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035972 Sep 02 17:17:54.736648 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 612/1298] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:17:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:17:54.811472 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-a9cc0efd-da1b-4011-a4ab-a329d8181786 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "DELETE /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 204 len: 0 microversion: 2.1 time: 0.163563 Sep 02 17:17:54.813866 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 687/1299] 10.222.0.41 () {58 vars in 1239 bytes} [Thu Sep 2 17:17:54 2021] DELETE /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 17:17:54.822931 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-9549d626-c9f6-4f53-8547-fa8c4d2490af tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:54.823799 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-9549d626-c9f6-4f53-8547-fa8c4d2490af tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:54.830847 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9549d626-c9f6-4f53-8547-fa8c4d2490af tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:54.831561 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9549d626-c9f6-4f53-8547-fa8c4d2490af tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:54.832554 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9549d626-c9f6-4f53-8547-fa8c4d2490af tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:54.833170 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9549d626-c9f6-4f53-8547-fa8c4d2490af tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:55.008751 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-9549d626-c9f6-4f53-8547-fa8c4d2490af tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:55.017574 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-9549d626-c9f6-4f53-8547-fa8c4d2490af tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1566 microversion: 2.1 time: 0.198702 Sep 02 17:17:55.021921 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 613/1300] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:54 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1566 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:55.562047 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-7e6cc4f0-a2e8-44c9-b253-a75ae0ef50de req-ffd0a3d1-8705-43d6-b16f-f4f8216373b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea9c64d9-b562-4bb6-88a2-88434835b7c8", "name": "network-vif-plugged", "status": "completed", "tag": "3425a5d0-ec45-4ecb-8ce4-10ea503dba12"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:17:55.564915 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:17:55.564915 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:17:55.577966 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-7e6cc4f0-a2e8-44c9-b253-a75ae0ef50de req-ffd0a3d1-8705-43d6-b16f-f4f8216373b1 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:55.580128 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-7e6cc4f0-a2e8-44c9-b253-a75ae0ef50de req-ffd0a3d1-8705-43d6-b16f-f4f8216373b1 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:55.593317 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-7e6cc4f0-a2e8-44c9-b253-a75ae0ef50de req-ffd0a3d1-8705-43d6-b16f-f4f8216373b1 service nova] Creating event network-vif-plugged:3425a5d0-ec45-4ecb-8ce4-10ea503dba12 for instance ea9c64d9-b562-4bb6-88a2-88434835b7c8 on hv-cinder-80626 Sep 02 17:17:55.598715 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-7e6cc4f0-a2e8-44c9-b253-a75ae0ef50de req-ffd0a3d1-8705-43d6-b16f-f4f8216373b1 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042859 Sep 02 17:17:55.600177 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 688/1301] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:17:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:17:55.715280 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-00c4f2f7-a19f-4225-90fe-5dd44688c4b3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:55.717373 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-00c4f2f7-a19f-4225-90fe-5dd44688c4b3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:55.728317 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-00c4f2f7-a19f-4225-90fe-5dd44688c4b3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:55.730455 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-00c4f2f7-a19f-4225-90fe-5dd44688c4b3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:55.731519 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-00c4f2f7-a19f-4225-90fe-5dd44688c4b3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:55.733206 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-00c4f2f7-a19f-4225-90fe-5dd44688c4b3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:55.981237 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-00c4f2f7-a19f-4225-90fe-5dd44688c4b3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:55.990844 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-00c4f2f7-a19f-4225-90fe-5dd44688c4b3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8" status: 200 len: 1361 microversion: 2.1 time: 0.284668 Sep 02 17:17:56.003718 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 614/1302] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:55 2021] GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8 => generated 1361 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:56.037980 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-fba9334e-280a-4bba-90c9-6e3f1209fa6f tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:56.039372 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-fba9334e-280a-4bba-90c9-6e3f1209fa6f tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:56.045806 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fba9334e-280a-4bba-90c9-6e3f1209fa6f tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:56.046617 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fba9334e-280a-4bba-90c9-6e3f1209fa6f tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:56.047647 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fba9334e-280a-4bba-90c9-6e3f1209fa6f tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:56.048690 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fba9334e-280a-4bba-90c9-6e3f1209fa6f tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:56.292619 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-fba9334e-280a-4bba-90c9-6e3f1209fa6f tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:56.300365 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-fba9334e-280a-4bba-90c9-6e3f1209fa6f tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1566 microversion: 2.1 time: 0.266261 Sep 02 17:17:56.300721 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 689/1303] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:56 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1566 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:57.020031 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-b72d9e14-5c2d-4355-beac-90c525f203e8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:57.020643 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-b72d9e14-5c2d-4355-beac-90c525f203e8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:57.026801 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b72d9e14-5c2d-4355-beac-90c525f203e8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:57.027247 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b72d9e14-5c2d-4355-beac-90c525f203e8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:57.028003 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b72d9e14-5c2d-4355-beac-90c525f203e8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:57.028432 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b72d9e14-5c2d-4355-beac-90c525f203e8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:57.290187 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-b72d9e14-5c2d-4355-beac-90c525f203e8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:57.298879 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-b72d9e14-5c2d-4355-beac-90c525f203e8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8" status: 200 len: 1361 microversion: 2.1 time: 0.282921 Sep 02 17:17:57.304203 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 615/1304] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:57 2021] GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8 => generated 1361 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:57.317455 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-a6c56505-dfa4-493c-b059-823901dfef2e tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:57.318723 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-a6c56505-dfa4-493c-b059-823901dfef2e tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:57.329280 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a6c56505-dfa4-493c-b059-823901dfef2e tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:57.331172 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a6c56505-dfa4-493c-b059-823901dfef2e tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:57.332900 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a6c56505-dfa4-493c-b059-823901dfef2e tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:57.335802 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-a6c56505-dfa4-493c-b059-823901dfef2e tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:57.632824 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-a6c56505-dfa4-493c-b059-823901dfef2e tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:57.641429 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-a6c56505-dfa4-493c-b059-823901dfef2e tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1449 microversion: 2.1 time: 0.328306 Sep 02 17:17:57.652407 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 690/1305] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:57 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1449 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:57.916881 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [req-bcaee894-6ff0-4e13-b39d-3e33fce1b5f7 req-bfc86a40-4f61-404d-9079-1102a210c022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cea6ec2a-41c7-41c5-8471-3da2ba130315", "name": "network-vif-deleted", "tag": "f0347608-2078-4ebd-b282-53b22f166ac6"}]} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:17:57.918580 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:17:57.918580 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: warnings.warn(msg) Sep 02 17:17:57.930016 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-bcaee894-6ff0-4e13-b39d-3e33fce1b5f7 req-bfc86a40-4f61-404d-9079-1102a210c022 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:57.932381 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-bcaee894-6ff0-4e13-b39d-3e33fce1b5f7 req-bfc86a40-4f61-404d-9079-1102a210c022 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:57.946336 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.compute.server_external_events [req-bcaee894-6ff0-4e13-b39d-3e33fce1b5f7 req-bfc86a40-4f61-404d-9079-1102a210c022 service nova] Creating event network-vif-deleted:f0347608-2078-4ebd-b282-53b22f166ac6 for instance cea6ec2a-41c7-41c5-8471-3da2ba130315 on hv-cinder-80626 Sep 02 17:17:57.953273 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [req-bcaee894-6ff0-4e13-b39d-3e33fce1b5f7 req-bfc86a40-4f61-404d-9079-1102a210c022 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039892 Sep 02 17:17:57.954389 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 616/1306] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:17:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:17:58.317612 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-985461a0-709c-4f92-9b1d-00b61da3af7c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:58.319086 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-985461a0-709c-4f92-9b1d-00b61da3af7c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:58.331201 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-985461a0-709c-4f92-9b1d-00b61da3af7c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:58.335289 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-985461a0-709c-4f92-9b1d-00b61da3af7c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:58.336686 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-985461a0-709c-4f92-9b1d-00b61da3af7c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:58.337345 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-985461a0-709c-4f92-9b1d-00b61da3af7c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:58.521053 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-985461a0-709c-4f92-9b1d-00b61da3af7c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:58.533535 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-985461a0-709c-4f92-9b1d-00b61da3af7c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8" status: 200 len: 1547 microversion: 2.1 time: 0.220729 Sep 02 17:17:58.538610 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 691/1307] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:58 2021] GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8 => generated 1547 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:17:58.550333 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-fa816267-f414-48f7-906b-703da21ee9a7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:58.551799 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-fa816267-f414-48f7-906b-703da21ee9a7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:58.558612 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fa816267-f414-48f7-906b-703da21ee9a7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:58.559387 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fa816267-f414-48f7-906b-703da21ee9a7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:58.560330 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fa816267-f414-48f7-906b-703da21ee9a7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:58.561129 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fa816267-f414-48f7-906b-703da21ee9a7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:58.658915 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-804c3f0e-92ce-448c-906f-91c55a6d32f3 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:58.659540 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-804c3f0e-92ce-448c-906f-91c55a6d32f3 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:58.667213 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-804c3f0e-92ce-448c-906f-91c55a6d32f3 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:58.667588 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-804c3f0e-92ce-448c-906f-91c55a6d32f3 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:58.668388 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-804c3f0e-92ce-448c-906f-91c55a6d32f3 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:58.668826 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-804c3f0e-92ce-448c-906f-91c55a6d32f3 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:58.703267 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-fa816267-f414-48f7-906b-703da21ee9a7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.156892 Sep 02 17:17:58.704333 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 617/1308] 10.222.0.41 () {58 vars in 1275 bytes} [Thu Sep 2 17:17:58 2021] GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/os-interface => generated 284 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:17:58.751208 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-804c3f0e-92ce-448c-906f-91c55a6d32f3 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:58.751670 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-804c3f0e-92ce-448c-906f-91c55a6d32f3 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:58.752119 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.objects.instance [None req-804c3f0e-92ce-448c-906f-91c55a6d32f3 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lazy-loading 'fault' on Instance uuid cea6ec2a-41c7-41c5-8471-3da2ba130315 {{(pid=108418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 17:17:58.857448 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-804c3f0e-92ce-448c-906f-91c55a6d32f3 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bdfa1e28abf74f40b4d4456142c8f33e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1187a96ac5fd43ed8833b20d6e853409', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:17:58.868140 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-804c3f0e-92ce-448c-906f-91c55a6d32f3 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 200 len: 1224 microversion: 2.1 time: 0.212765 Sep 02 17:17:58.882800 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 692/1309] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:58 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 1224 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:17:59.885251 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-dc20a724-daae-4e2d-969e-c7813a47ab8b tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:17:59.886571 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-dc20a724-daae-4e2d-969e-c7813a47ab8b tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] [instance: cea6ec2a-41c7-41c5-8471-3da2ba130315] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:17:59.901281 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-dc20a724-daae-4e2d-969e-c7813a47ab8b tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:59.902033 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-dc20a724-daae-4e2d-969e-c7813a47ab8b tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:59.903021 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-dc20a724-daae-4e2d-969e-c7813a47ab8b tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:17:59.903616 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-dc20a724-daae-4e2d-969e-c7813a47ab8b tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:17:59.936991 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.wsgi [None req-dc20a724-daae-4e2d-969e-c7813a47ab8b tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] HTTP exception thrown: Instance cea6ec2a-41c7-41c5-8471-3da2ba130315 could not be found. Sep 02 17:17:59.937925 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-dc20a724-daae-4e2d-969e-c7813a47ab8b tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Returning 404 to user: Instance cea6ec2a-41c7-41c5-8471-3da2ba130315 could not be found. {{(pid=108417) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:17:59.938971 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-dc20a724-daae-4e2d-969e-c7813a47ab8b tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315" status: 404 len: 111 microversion: 2.1 time: 0.057506 Sep 02 17:17:59.946497 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 618/1310] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:17:59 2021] GET /compute/v2.1/servers/cea6ec2a-41c7-41c5-8471-3da2ba130315 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 17:18:00.275402 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [req-d696f9c1-dbe9-4c1a-97e9-0a03051688d5 req-4daf40dc-89fb-4723-849e-b9d43f934bbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea9c64d9-b562-4bb6-88a2-88434835b7c8", "tag": "3425a5d0-ec45-4ecb-8ce4-10ea503dba12"}]} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:00.276892 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:18:00.276892 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: warnings.warn(msg) Sep 02 17:18:00.277649 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-806c7c9a-0a21-435d-8c90-55b6de03e176 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:00.278754 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-806c7c9a-0a21-435d-8c90-55b6de03e176 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:00.293780 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-d696f9c1-dbe9-4c1a-97e9-0a03051688d5 req-4daf40dc-89fb-4723-849e-b9d43f934bbd service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:00.295717 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-806c7c9a-0a21-435d-8c90-55b6de03e176 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:00.296166 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-806c7c9a-0a21-435d-8c90-55b6de03e176 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:00.296807 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-d696f9c1-dbe9-4c1a-97e9-0a03051688d5 req-4daf40dc-89fb-4723-849e-b9d43f934bbd service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:00.301613 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-806c7c9a-0a21-435d-8c90-55b6de03e176 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:00.307340 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-806c7c9a-0a21-435d-8c90-55b6de03e176 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:00.334408 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.compute.server_external_events [req-d696f9c1-dbe9-4c1a-97e9-0a03051688d5 req-4daf40dc-89fb-4723-849e-b9d43f934bbd service nova] Creating event network-changed:3425a5d0-ec45-4ecb-8ce4-10ea503dba12 for instance ea9c64d9-b562-4bb6-88a2-88434835b7c8 on hv-cinder-80626 Sep 02 17:18:00.342469 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [req-d696f9c1-dbe9-4c1a-97e9-0a03051688d5 req-4daf40dc-89fb-4723-849e-b9d43f934bbd service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070462 Sep 02 17:18:00.343117 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 619/1311] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:18:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:18:00.348808 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-41c21c07-f87e-453d-a06b-5407466e0812 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] Calling method '.version_select at 0x7fca984ca160>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:18:00.383989 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-41c21c07-f87e-453d-a06b-5407466e0812 tempest-TestShelveInstance-622910068 tempest-TestShelveInstance-622910068-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1011419605" status: 202 len: 0 microversion: 2.1 time: 0.038884 Sep 02 17:18:00.384576 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 620/1312] 10.222.0.41 () {58 vars in 1254 bytes} [Thu Sep 2 17:18:00 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1011419605 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:18:00.439064 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-806c7c9a-0a21-435d-8c90-55b6de03e176 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action" status: 200 len: 14 microversion: 2.1 time: 0.171400 Sep 02 17:18:00.439860 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 693/1313] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:18:00 2021] POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action => generated 14 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 17:18:01.456587 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-b7c15a99-3dcf-4b7f-877d-52adb2d0bf61 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:01.458641 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-b7c15a99-3dcf-4b7f-877d-52adb2d0bf61 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:01.469021 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b7c15a99-3dcf-4b7f-877d-52adb2d0bf61 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:01.473539 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b7c15a99-3dcf-4b7f-877d-52adb2d0bf61 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:01.474789 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b7c15a99-3dcf-4b7f-877d-52adb2d0bf61 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:01.475474 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b7c15a99-3dcf-4b7f-877d-52adb2d0bf61 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:01.603959 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-b7c15a99-3dcf-4b7f-877d-52adb2d0bf61 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action" status: 200 len: 14 microversion: 2.1 time: 0.151594 Sep 02 17:18:01.605371 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 621/1314] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:18:01 2021] POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 17:18:02.617492 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-58c9cf3d-2b5c-45f0-b8f7-f47fb67a73ca tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:02.619014 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-58c9cf3d-2b5c-45f0-b8f7-f47fb67a73ca tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:02.629387 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-58c9cf3d-2b5c-45f0-b8f7-f47fb67a73ca tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:02.630127 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-58c9cf3d-2b5c-45f0-b8f7-f47fb67a73ca tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:02.631176 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-58c9cf3d-2b5c-45f0-b8f7-f47fb67a73ca tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:02.631772 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-58c9cf3d-2b5c-45f0-b8f7-f47fb67a73ca tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:02.756390 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-58c9cf3d-2b5c-45f0-b8f7-f47fb67a73ca tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action" status: 200 len: 14 microversion: 2.1 time: 0.143753 Sep 02 17:18:02.757606 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 694/1315] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:18:02 2021] POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action => generated 14 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 17:18:03.770424 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-27c7474b-e1ef-49b1-a58f-28214b0db0ef tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:03.771699 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-27c7474b-e1ef-49b1-a58f-28214b0db0ef tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:03.783298 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-27c7474b-e1ef-49b1-a58f-28214b0db0ef tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:03.783686 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-27c7474b-e1ef-49b1-a58f-28214b0db0ef tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:03.784680 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-27c7474b-e1ef-49b1-a58f-28214b0db0ef tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:03.785161 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-27c7474b-e1ef-49b1-a58f-28214b0db0ef tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:03.893228 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-27c7474b-e1ef-49b1-a58f-28214b0db0ef tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action" status: 200 len: 14 microversion: 2.1 time: 0.128400 Sep 02 17:18:03.897064 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 622/1316] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:18:03 2021] POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 17:18:04.904727 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-c8794728-d397-4a1d-89a4-e059f7e43271 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:04.905729 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-c8794728-d397-4a1d-89a4-e059f7e43271 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:04.924872 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c8794728-d397-4a1d-89a4-e059f7e43271 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:04.925320 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c8794728-d397-4a1d-89a4-e059f7e43271 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:04.926302 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c8794728-d397-4a1d-89a4-e059f7e43271 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:04.926672 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c8794728-d397-4a1d-89a4-e059f7e43271 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:05.032728 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-c8794728-d397-4a1d-89a4-e059f7e43271 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action" status: 200 len: 14 microversion: 2.1 time: 0.131770 Sep 02 17:18:05.034185 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 695/1317] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:18:04 2021] POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 17:18:06.045158 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-8f07a8f1-091d-4d6b-b436-24f4c4695133 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:06.049527 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-8f07a8f1-091d-4d6b-b436-24f4c4695133 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:06.056576 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8f07a8f1-091d-4d6b-b436-24f4c4695133 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:06.057026 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8f07a8f1-091d-4d6b-b436-24f4c4695133 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:06.057804 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8f07a8f1-091d-4d6b-b436-24f4c4695133 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:06.058427 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8f07a8f1-091d-4d6b-b436-24f4c4695133 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:06.148859 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-8f07a8f1-091d-4d6b-b436-24f4c4695133 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action" status: 200 len: 14 microversion: 2.1 time: 0.107833 Sep 02 17:18:06.149825 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 623/1318] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:18:06 2021] POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action => generated 14 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 02 17:18:07.162007 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-290b4449-96f1-4e6c-bf8c-5cdb6f9a740c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:07.165363 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-290b4449-96f1-4e6c-bf8c-5cdb6f9a740c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:07.181557 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-290b4449-96f1-4e6c-bf8c-5cdb6f9a740c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:07.190900 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-290b4449-96f1-4e6c-bf8c-5cdb6f9a740c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:07.191953 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-290b4449-96f1-4e6c-bf8c-5cdb6f9a740c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:07.192589 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-290b4449-96f1-4e6c-bf8c-5cdb6f9a740c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:07.287992 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-290b4449-96f1-4e6c-bf8c-5cdb6f9a740c tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action" status: 200 len: 14 microversion: 2.1 time: 0.131265 Sep 02 17:18:07.290117 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 696/1319] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:18:07 2021] POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action => generated 14 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 17:18:07.685916 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-a4743354-f533-449d-8c56-cd34204000bf tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Action: 'create', calling method: .version_select at 0x7fca9842e430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-721833664"}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:07.705619 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.quota [None req-a4743354-f533-449d-8c56-cd34204000bf tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Getting quotas for project 6f2001cfaa564496ba271b544cfdc14f. Resources: {'key_pairs'} {{(pid=108417) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 17:18:07.709992 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.quota [None req-a4743354-f533-449d-8c56-cd34204000bf tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Getting quotas for user 16afa61134d0457aa9f886c4bece5df2 and project 6f2001cfaa564496ba271b544cfdc14f. Resources: {'key_pairs'} {{(pid=108417) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 17:18:07.858206 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.quota [None req-a4743354-f533-449d-8c56-cd34204000bf tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Getting quotas for project 6f2001cfaa564496ba271b544cfdc14f. Resources: {'key_pairs'} {{(pid=108417) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 17:18:07.862246 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.quota [None req-a4743354-f533-449d-8c56-cd34204000bf tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Getting quotas for user 16afa61134d0457aa9f886c4bece5df2 and project 6f2001cfaa564496ba271b544cfdc14f. Resources: {'key_pairs'} {{(pid=108417) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 17:18:07.875434 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-a4743354-f533-449d-8c56-cd34204000bf tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.193486 Sep 02 17:18:07.882795 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 624/1320] 10.222.0.41 () {60 vars in 1158 bytes} [Thu Sep 2 17:18:07 2021] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:18:07.926139 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-ea6a9167-b7c3-49e6-b52b-a51af37834b9 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1207051236", "imageRef": "e987953c-c368-4ec6-92d3-3e9eedb25b93", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-721833664", "networks": [{"uuid": "15e4cc74-e900-43e3-b2db-b1a95536b9ef"}]}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:07.979233 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.network.neutron [None req-ea6a9167-b7c3-49e6-b52b-a51af37834b9 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] validate_networks() for [('15e4cc74-e900-43e3-b2db-b1a95536b9ef', None, None, None, None, None)] {{(pid=108418) validate_networks /opt/stack/nova/nova/network/neutron.py:2463}} Sep 02 17:18:08.299450 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-6b6d4f7f-088f-40ee-859c-a4535e02f549 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:08.300465 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-6b6d4f7f-088f-40ee-859c-a4535e02f549 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:08.306545 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6b6d4f7f-088f-40ee-859c-a4535e02f549 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:08.307189 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6b6d4f7f-088f-40ee-859c-a4535e02f549 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:08.307956 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6b6d4f7f-088f-40ee-859c-a4535e02f549 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:08.308386 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6b6d4f7f-088f-40ee-859c-a4535e02f549 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:08.412979 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-6b6d4f7f-088f-40ee-859c-a4535e02f549 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action" status: 200 len: 14 microversion: 2.1 time: 0.117077 Sep 02 17:18:08.413801 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 625/1321] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:18:08 2021] POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 02 17:18:08.552011 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-ea6a9167-b7c3-49e6-b52b-a51af37834b9 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Flavor limits 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 02 17:18:08.552500 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-ea6a9167-b7c3-49e6-b52b-a51af37834b9 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Image limits 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 02 17:18:08.552896 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-ea6a9167-b7c3-49e6-b52b-a51af37834b9 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Flavor pref 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 02 17:18:08.553308 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-ea6a9167-b7c3-49e6-b52b-a51af37834b9 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Image pref 0:0:0 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 02 17:18:08.553720 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.virt.hardware [None req-ea6a9167-b7c3-49e6-b52b-a51af37834b9 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108418) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 02 17:18:08.567434 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ea6a9167-b7c3-49e6-b52b-a51af37834b9 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:08.568074 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ea6a9167-b7c3-49e6-b52b-a51af37834b9 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:08.569048 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ea6a9167-b7c3-49e6-b52b-a51af37834b9 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:08.569654 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-ea6a9167-b7c3-49e6-b52b-a51af37834b9 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:08.588696 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.quota [None req-ea6a9167-b7c3-49e6-b52b-a51af37834b9 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Getting quotas for project 6f2001cfaa564496ba271b544cfdc14f. Resources: {'instances', 'cores', 'ram'} {{(pid=108418) _get_quotas /opt/stack/nova/nova/quota.py:387}} Sep 02 17:18:08.592609 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.quota [None req-ea6a9167-b7c3-49e6-b52b-a51af37834b9 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Getting quotas for user 16afa61134d0457aa9f886c4bece5df2 and project 6f2001cfaa564496ba271b544cfdc14f. Resources: {'instances', 'cores', 'ram'} {{(pid=108418) _get_quotas /opt/stack/nova/nova/quota.py:377}} Sep 02 17:18:08.603322 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-ea6a9167-b7c3-49e6-b52b-a51af37834b9 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Going to run 1 instances... {{(pid=108418) _provision_instances /opt/stack/nova/nova/compute/api.py:1349}} Sep 02 17:18:08.605673 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-ea6a9167-b7c3-49e6-b52b-a51af37834b9 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e987953c-c368-4ec6-92d3-3e9eedb25b93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108418) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1756}} Sep 02 17:18:08.652422 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-ea6a9167-b7c3-49e6-b52b-a51af37834b9 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.730584 Sep 02 17:18:08.657811 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 697/1322] 10.222.0.41 () {60 vars in 1147 bytes} [Thu Sep 2 17:18:07 2021] POST /compute/v2.1/servers => generated 380 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 02 17:18:08.664138 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-0eff4b3a-32f8-483a-8347-d34d77b889ae tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:18:08.664848 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-0eff4b3a-32f8-483a-8347-d34d77b889ae tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:08.723100 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-0eff4b3a-32f8-483a-8347-d34d77b889ae tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afa61134d0457aa9f886c4bece5df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2001cfaa564496ba271b544cfdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:18:08.731641 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-0eff4b3a-32f8-483a-8347-d34d77b889ae tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 200 len: 1258 microversion: 2.1 time: 0.071612 Sep 02 17:18:08.732412 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 626/1323] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:18:08 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:18:09.424444 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-fd8f92ed-41cd-4dcf-bb39-28aae58dccdf tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:09.425428 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-fd8f92ed-41cd-4dcf-bb39-28aae58dccdf tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:09.431656 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fd8f92ed-41cd-4dcf-bb39-28aae58dccdf tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:09.432111 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fd8f92ed-41cd-4dcf-bb39-28aae58dccdf tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:09.432867 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fd8f92ed-41cd-4dcf-bb39-28aae58dccdf tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:09.433295 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fd8f92ed-41cd-4dcf-bb39-28aae58dccdf tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:09.521613 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-fd8f92ed-41cd-4dcf-bb39-28aae58dccdf tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action" status: 200 len: 14 microversion: 2.1 time: 0.101181 Sep 02 17:18:09.522268 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 698/1324] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:18:09 2021] POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 17:18:09.749455 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-a7687167-5f89-4c4c-b88a-27870f4fdcc4 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:18:09.751464 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-a7687167-5f89-4c4c-b88a-27870f4fdcc4 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:09.758523 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a7687167-5f89-4c4c-b88a-27870f4fdcc4 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:09.758938 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a7687167-5f89-4c4c-b88a-27870f4fdcc4 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:09.759758 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a7687167-5f89-4c4c-b88a-27870f4fdcc4 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:09.760134 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a7687167-5f89-4c4c-b88a-27870f4fdcc4 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:09.821334 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-a7687167-5f89-4c4c-b88a-27870f4fdcc4 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afa61134d0457aa9f886c4bece5df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2001cfaa564496ba271b544cfdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:18:09.830313 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-a7687167-5f89-4c4c-b88a-27870f4fdcc4 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 200 len: 1318 microversion: 2.1 time: 0.084565 Sep 02 17:18:09.839504 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 627/1325] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:18:09 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 1318 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:18:10.533478 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-eb067041-1390-48fd-8266-1885176d593a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:10.534718 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-eb067041-1390-48fd-8266-1885176d593a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:10.545326 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-eb067041-1390-48fd-8266-1885176d593a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:10.545865 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-eb067041-1390-48fd-8266-1885176d593a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:10.546716 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-eb067041-1390-48fd-8266-1885176d593a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:10.547246 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-eb067041-1390-48fd-8266-1885176d593a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:10.847411 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-367352f0-5890-4d51-898c-5fd7d13b4c32 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:18:10.848711 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-367352f0-5890-4d51-898c-5fd7d13b4c32 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:10.855541 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-367352f0-5890-4d51-898c-5fd7d13b4c32 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:10.856302 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-367352f0-5890-4d51-898c-5fd7d13b4c32 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:10.857286 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-367352f0-5890-4d51-898c-5fd7d13b4c32 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:10.857922 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-367352f0-5890-4d51-898c-5fd7d13b4c32 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:10.985903 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-367352f0-5890-4d51-898c-5fd7d13b4c32 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afa61134d0457aa9f886c4bece5df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2001cfaa564496ba271b544cfdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:18:10.993616 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-367352f0-5890-4d51-898c-5fd7d13b4c32 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 200 len: 1358 microversion: 2.1 time: 0.149712 Sep 02 17:18:10.994172 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 628/1326] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:18:10 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:18:12.010713 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-da924832-47c7-4191-8f37-bb390cd9a5bf tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:18:12.011351 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-da924832-47c7-4191-8f37-bb390cd9a5bf tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:12.018143 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-da924832-47c7-4191-8f37-bb390cd9a5bf tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:12.018586 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-da924832-47c7-4191-8f37-bb390cd9a5bf tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:12.019370 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-da924832-47c7-4191-8f37-bb390cd9a5bf tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:12.019791 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-da924832-47c7-4191-8f37-bb390cd9a5bf tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:12.138500 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-da924832-47c7-4191-8f37-bb390cd9a5bf tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afa61134d0457aa9f886c4bece5df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2001cfaa564496ba271b544cfdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:18:12.146085 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-da924832-47c7-4191-8f37-bb390cd9a5bf tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 200 len: 1358 microversion: 2.1 time: 0.139132 Sep 02 17:18:12.146645 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 629/1327] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:18:12 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 1358 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:18:13.162374 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-2376b045-b082-4aed-9eeb-e16c057b1560 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:18:13.163127 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-2376b045-b082-4aed-9eeb-e16c057b1560 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:13.172278 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2376b045-b082-4aed-9eeb-e16c057b1560 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:13.172737 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2376b045-b082-4aed-9eeb-e16c057b1560 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:13.173531 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2376b045-b082-4aed-9eeb-e16c057b1560 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:13.173969 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2376b045-b082-4aed-9eeb-e16c057b1560 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:13.294250 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-2376b045-b082-4aed-9eeb-e16c057b1560 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afa61134d0457aa9f886c4bece5df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2001cfaa564496ba271b544cfdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:18:13.302189 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-2376b045-b082-4aed-9eeb-e16c057b1560 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 200 len: 1358 microversion: 2.1 time: 0.143487 Sep 02 17:18:13.302779 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 630/1328] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:18:13 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 1358 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:18:14.319133 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-1245bfcc-2002-479a-b267-fb60b7385bca tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:18:14.319768 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-1245bfcc-2002-479a-b267-fb60b7385bca tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:14.325509 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1245bfcc-2002-479a-b267-fb60b7385bca tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:14.325953 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1245bfcc-2002-479a-b267-fb60b7385bca tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:14.326760 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1245bfcc-2002-479a-b267-fb60b7385bca tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:14.327193 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1245bfcc-2002-479a-b267-fb60b7385bca tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:14.442917 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-1245bfcc-2002-479a-b267-fb60b7385bca tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afa61134d0457aa9f886c4bece5df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2001cfaa564496ba271b544cfdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:18:14.449987 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-1245bfcc-2002-479a-b267-fb60b7385bca tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 200 len: 1358 microversion: 2.1 time: 0.134477 Sep 02 17:18:14.450535 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 631/1329] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:18:14 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 1358 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:18:15.466191 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-b36b5a85-33e3-407f-951a-5a80b59dc1c1 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:18:15.467659 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-b36b5a85-33e3-407f-951a-5a80b59dc1c1 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:15.474036 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b36b5a85-33e3-407f-951a-5a80b59dc1c1 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:15.475331 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b36b5a85-33e3-407f-951a-5a80b59dc1c1 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:15.476328 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b36b5a85-33e3-407f-951a-5a80b59dc1c1 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:15.477026 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b36b5a85-33e3-407f-951a-5a80b59dc1c1 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:15.600429 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-b36b5a85-33e3-407f-951a-5a80b59dc1c1 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afa61134d0457aa9f886c4bece5df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2001cfaa564496ba271b544cfdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:18:15.608025 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-b36b5a85-33e3-407f-951a-5a80b59dc1c1 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 200 len: 1358 microversion: 2.1 time: 0.145524 Sep 02 17:18:15.608606 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 632/1330] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:18:15 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:18:16.629195 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-01883ed4-444b-49a6-8e7d-deea5698410e tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:18:16.629850 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-01883ed4-444b-49a6-8e7d-deea5698410e tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:16.636262 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-01883ed4-444b-49a6-8e7d-deea5698410e tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:16.636805 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-01883ed4-444b-49a6-8e7d-deea5698410e tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:16.637629 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-01883ed4-444b-49a6-8e7d-deea5698410e tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:16.638136 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-01883ed4-444b-49a6-8e7d-deea5698410e tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:16.760475 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-01883ed4-444b-49a6-8e7d-deea5698410e tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afa61134d0457aa9f886c4bece5df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2001cfaa564496ba271b544cfdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:18:16.768196 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-01883ed4-444b-49a6-8e7d-deea5698410e tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 200 len: 1358 microversion: 2.1 time: 0.143067 Sep 02 17:18:16.769025 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 633/1331] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:18:16 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 1358 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:18:17.785348 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-9f8749ab-1d81-4f61-b808-76fa9dc81cef tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:18:17.786063 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-9f8749ab-1d81-4f61-b808-76fa9dc81cef tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:17.792046 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9f8749ab-1d81-4f61-b808-76fa9dc81cef tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:17.792487 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9f8749ab-1d81-4f61-b808-76fa9dc81cef tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:17.793261 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9f8749ab-1d81-4f61-b808-76fa9dc81cef tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:17.793685 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9f8749ab-1d81-4f61-b808-76fa9dc81cef tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:17.915662 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-9f8749ab-1d81-4f61-b808-76fa9dc81cef tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afa61134d0457aa9f886c4bece5df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2001cfaa564496ba271b544cfdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:18:17.923436 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-9f8749ab-1d81-4f61-b808-76fa9dc81cef tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 200 len: 1358 microversion: 2.1 time: 0.141549 Sep 02 17:18:17.934742 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 634/1332] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:18:17 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 1358 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:18:18.944360 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-da981a1b-4ff2-4ba7-8599-9ce79b2102a1 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:18:18.945159 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-da981a1b-4ff2-4ba7-8599-9ce79b2102a1 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:18.961207 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-da981a1b-4ff2-4ba7-8599-9ce79b2102a1 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:18.961207 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-da981a1b-4ff2-4ba7-8599-9ce79b2102a1 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:18.961207 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-da981a1b-4ff2-4ba7-8599-9ce79b2102a1 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:18.961207 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-da981a1b-4ff2-4ba7-8599-9ce79b2102a1 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:19.086343 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-da981a1b-4ff2-4ba7-8599-9ce79b2102a1 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afa61134d0457aa9f886c4bece5df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2001cfaa564496ba271b544cfdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:18:19.093574 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-da981a1b-4ff2-4ba7-8599-9ce79b2102a1 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 200 len: 1358 microversion: 2.1 time: 0.155572 Sep 02 17:18:19.094161 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 635/1333] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:18:18 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:18:20.110429 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-0e26bbb5-84de-4b56-b1db-02c465baa270 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:18:20.111263 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-0e26bbb5-84de-4b56-b1db-02c465baa270 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:20.116999 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0e26bbb5-84de-4b56-b1db-02c465baa270 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:20.117792 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0e26bbb5-84de-4b56-b1db-02c465baa270 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:20.119138 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0e26bbb5-84de-4b56-b1db-02c465baa270 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:20.119793 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0e26bbb5-84de-4b56-b1db-02c465baa270 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:20.240559 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-0e26bbb5-84de-4b56-b1db-02c465baa270 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afa61134d0457aa9f886c4bece5df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2001cfaa564496ba271b544cfdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:18:20.248101 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-0e26bbb5-84de-4b56-b1db-02c465baa270 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 200 len: 1358 microversion: 2.1 time: 0.141097 Sep 02 17:18:20.248682 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 636/1334] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:18:20 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 1358 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:18:21.264221 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-f46d5383-487a-4a90-84a2-8ecd80c11bf6 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:18:21.264826 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-f46d5383-487a-4a90-84a2-8ecd80c11bf6 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:21.270675 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f46d5383-487a-4a90-84a2-8ecd80c11bf6 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:21.271120 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f46d5383-487a-4a90-84a2-8ecd80c11bf6 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:21.271866 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f46d5383-487a-4a90-84a2-8ecd80c11bf6 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:21.272288 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f46d5383-487a-4a90-84a2-8ecd80c11bf6 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:21.392831 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-f46d5383-487a-4a90-84a2-8ecd80c11bf6 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afa61134d0457aa9f886c4bece5df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2001cfaa564496ba271b544cfdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:18:21.399943 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-f46d5383-487a-4a90-84a2-8ecd80c11bf6 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 200 len: 1358 microversion: 2.1 time: 0.139537 Sep 02 17:18:21.400494 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 637/1335] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:18:21 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 1358 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:18:22.415871 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-370be073-5afd-4d18-ad55-87306eda2466 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:18:22.416502 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-370be073-5afd-4d18-ad55-87306eda2466 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:22.422265 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-370be073-5afd-4d18-ad55-87306eda2466 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:22.422743 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-370be073-5afd-4d18-ad55-87306eda2466 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:22.423504 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-370be073-5afd-4d18-ad55-87306eda2466 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:22.423936 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-370be073-5afd-4d18-ad55-87306eda2466 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:22.543195 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-370be073-5afd-4d18-ad55-87306eda2466 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afa61134d0457aa9f886c4bece5df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2001cfaa564496ba271b544cfdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:18:22.550314 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-370be073-5afd-4d18-ad55-87306eda2466 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 200 len: 1358 microversion: 2.1 time: 0.138176 Sep 02 17:18:22.550904 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 638/1336] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:18:22 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 1358 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:18:23.223352 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-eb067041-1390-48fd-8266-1885176d593a tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action" status: 200 len: 25364 microversion: 2.1 time: 12.694046 Sep 02 17:18:23.224369 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 699/1337] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:18:10 2021] POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action => generated 25364 bytes in 12696 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:18:23.566892 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-396c4d21-dbd1-4beb-88f8-c40b07c8b375 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:18:23.568195 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-396c4d21-dbd1-4beb-88f8-c40b07c8b375 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:23.575610 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-396c4d21-dbd1-4beb-88f8-c40b07c8b375 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:23.576058 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-396c4d21-dbd1-4beb-88f8-c40b07c8b375 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:23.576985 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-396c4d21-dbd1-4beb-88f8-c40b07c8b375 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:23.577451 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-396c4d21-dbd1-4beb-88f8-c40b07c8b375 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:23.707188 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-396c4d21-dbd1-4beb-88f8-c40b07c8b375 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afa61134d0457aa9f886c4bece5df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2001cfaa564496ba271b544cfdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:18:23.715280 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-396c4d21-dbd1-4beb-88f8-c40b07c8b375 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 200 len: 1358 microversion: 2.1 time: 0.152332 Sep 02 17:18:23.715843 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 639/1338] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:18:23 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:18:23.787105 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-56146f3f-9022-4a56-9093-5261fb75b028 req-cf4d04d4-ff94-40f2-917c-328c3ab11b47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "371ab7f3-5976-495e-90cb-d0e9035d8eb1", "tag": "31f557d1-9615-485b-967b-0c514ea54c30"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:23.788788 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:18:23.788788 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:18:23.803754 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-56146f3f-9022-4a56-9093-5261fb75b028 req-cf4d04d4-ff94-40f2-917c-328c3ab11b47 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:23.804591 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-56146f3f-9022-4a56-9093-5261fb75b028 req-cf4d04d4-ff94-40f2-917c-328c3ab11b47 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:23.817873 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-56146f3f-9022-4a56-9093-5261fb75b028 req-cf4d04d4-ff94-40f2-917c-328c3ab11b47 service nova] Creating event network-changed:31f557d1-9615-485b-967b-0c514ea54c30 for instance 371ab7f3-5976-495e-90cb-d0e9035d8eb1 on hv-cinder-80626 Sep 02 17:18:23.823105 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-56146f3f-9022-4a56-9093-5261fb75b028 req-cf4d04d4-ff94-40f2-917c-328c3ab11b47 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046620 Sep 02 17:18:23.823703 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 700/1339] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:18:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:18:24.235360 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-9f241b16-9806-4609-b6fe-ac51fb82489b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:24.236342 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-9f241b16-9806-4609-b6fe-ac51fb82489b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:24.242130 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9f241b16-9806-4609-b6fe-ac51fb82489b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:24.242561 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9f241b16-9806-4609-b6fe-ac51fb82489b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:24.243605 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9f241b16-9806-4609-b6fe-ac51fb82489b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:24.244040 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-9f241b16-9806-4609-b6fe-ac51fb82489b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:24.390430 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-9f241b16-9806-4609-b6fe-ac51fb82489b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action" status: 200 len: 26705 microversion: 2.1 time: 0.159172 Sep 02 17:18:24.391106 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 640/1340] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:18:24 2021] POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action => generated 26705 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:18:24.732796 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-16a3a05d-f3a8-4654-8475-e916fba7a3b7 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:18:24.733525 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-16a3a05d-f3a8-4654-8475-e916fba7a3b7 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:24.740225 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-16a3a05d-f3a8-4654-8475-e916fba7a3b7 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:24.740673 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-16a3a05d-f3a8-4654-8475-e916fba7a3b7 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:24.741440 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-16a3a05d-f3a8-4654-8475-e916fba7a3b7 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:24.741875 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-16a3a05d-f3a8-4654-8475-e916fba7a3b7 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:24.889796 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-16a3a05d-f3a8-4654-8475-e916fba7a3b7 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afa61134d0457aa9f886c4bece5df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2001cfaa564496ba271b544cfdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:18:24.897614 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-16a3a05d-f3a8-4654-8475-e916fba7a3b7 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 200 len: 1358 microversion: 2.1 time: 0.168847 Sep 02 17:18:24.898167 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 701/1341] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:18:24 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:18:25.401833 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-102feb61-b654-4edb-a904-e6a0749f77f3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:25.402876 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-102feb61-b654-4edb-a904-e6a0749f77f3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:25.409579 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-102feb61-b654-4edb-a904-e6a0749f77f3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:25.410016 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-102feb61-b654-4edb-a904-e6a0749f77f3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:25.410817 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-102feb61-b654-4edb-a904-e6a0749f77f3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:25.411247 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-102feb61-b654-4edb-a904-e6a0749f77f3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:25.511876 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-102feb61-b654-4edb-a904-e6a0749f77f3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action" status: 200 len: 27474 microversion: 2.1 time: 0.113974 Sep 02 17:18:25.512492 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 641/1342] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:18:25 2021] POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action => generated 27474 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:18:25.913345 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-68e6fae0-fd76-41fe-930f-5271d9db57f9 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:18:25.913949 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-68e6fae0-fd76-41fe-930f-5271d9db57f9 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:25.919776 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-68e6fae0-fd76-41fe-930f-5271d9db57f9 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:25.920228 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-68e6fae0-fd76-41fe-930f-5271d9db57f9 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:25.920986 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-68e6fae0-fd76-41fe-930f-5271d9db57f9 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:25.921417 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-68e6fae0-fd76-41fe-930f-5271d9db57f9 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:26.041536 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-68e6fae0-fd76-41fe-930f-5271d9db57f9 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afa61134d0457aa9f886c4bece5df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2001cfaa564496ba271b544cfdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:18:26.049385 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-68e6fae0-fd76-41fe-930f-5271d9db57f9 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 200 len: 1358 microversion: 2.1 time: 0.139694 Sep 02 17:18:26.049933 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 702/1343] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:18:25 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 1358 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:18:26.523829 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-c45032e2-8504-43ab-bab2-57604fcd25c2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:26.524772 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-c45032e2-8504-43ab-bab2-57604fcd25c2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:26.531341 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c45032e2-8504-43ab-bab2-57604fcd25c2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:26.531846 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c45032e2-8504-43ab-bab2-57604fcd25c2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:26.532614 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c45032e2-8504-43ab-bab2-57604fcd25c2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:26.533107 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c45032e2-8504-43ab-bab2-57604fcd25c2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:26.630406 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-c45032e2-8504-43ab-bab2-57604fcd25c2 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action" status: 200 len: 27889 microversion: 2.1 time: 0.110539 Sep 02 17:18:26.631313 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 642/1344] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:18:26 2021] POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action => generated 27889 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:18:27.065883 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-6cfbaa07-74d4-4935-9b76-149d5303b21e tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:18:27.066513 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-6cfbaa07-74d4-4935-9b76-149d5303b21e tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:27.072717 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6cfbaa07-74d4-4935-9b76-149d5303b21e tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:27.073197 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6cfbaa07-74d4-4935-9b76-149d5303b21e tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:27.073958 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6cfbaa07-74d4-4935-9b76-149d5303b21e tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:27.074388 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6cfbaa07-74d4-4935-9b76-149d5303b21e tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:27.193111 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-6cfbaa07-74d4-4935-9b76-149d5303b21e tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afa61134d0457aa9f886c4bece5df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2001cfaa564496ba271b544cfdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:18:27.200248 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-6cfbaa07-74d4-4935-9b76-149d5303b21e tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 200 len: 1358 microversion: 2.1 time: 0.138560 Sep 02 17:18:27.209294 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 703/1345] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:18:27 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 1358 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:18:27.641831 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-96f82b80-888f-4b0a-a8c1-509b615a577f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:27.642850 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-96f82b80-888f-4b0a-a8c1-509b615a577f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:27.649192 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-96f82b80-888f-4b0a-a8c1-509b615a577f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:27.649643 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-96f82b80-888f-4b0a-a8c1-509b615a577f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:27.650406 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-96f82b80-888f-4b0a-a8c1-509b615a577f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:27.650940 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-96f82b80-888f-4b0a-a8c1-509b615a577f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:27.748561 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-96f82b80-888f-4b0a-a8c1-509b615a577f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action" status: 200 len: 28185 microversion: 2.1 time: 0.110616 Sep 02 17:18:27.749198 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 643/1346] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:18:27 2021] POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action => generated 28185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:18:28.216658 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-582ba126-c3ad-489d-aeab-e882ce760202 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:18:28.217265 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-582ba126-c3ad-489d-aeab-e882ce760202 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:28.223192 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-582ba126-c3ad-489d-aeab-e882ce760202 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:28.223642 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-582ba126-c3ad-489d-aeab-e882ce760202 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:28.224404 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-582ba126-c3ad-489d-aeab-e882ce760202 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:28.224833 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-582ba126-c3ad-489d-aeab-e882ce760202 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:28.340593 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-582ba126-c3ad-489d-aeab-e882ce760202 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afa61134d0457aa9f886c4bece5df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2001cfaa564496ba271b544cfdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:18:28.348211 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-582ba126-c3ad-489d-aeab-e882ce760202 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 200 len: 1358 microversion: 2.1 time: 0.135205 Sep 02 17:18:28.348763 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 704/1347] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:18:28 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 1358 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:18:28.760733 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-1c7847e8-25f7-44ce-bfeb-359cedb4f588 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:28.761632 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-1c7847e8-25f7-44ce-bfeb-359cedb4f588 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:28.768529 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1c7847e8-25f7-44ce-bfeb-359cedb4f588 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:28.768970 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1c7847e8-25f7-44ce-bfeb-359cedb4f588 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:28.769724 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1c7847e8-25f7-44ce-bfeb-359cedb4f588 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:28.770152 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1c7847e8-25f7-44ce-bfeb-359cedb4f588 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:28.857192 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-1c7847e8-25f7-44ce-bfeb-359cedb4f588 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action" status: 200 len: 28185 microversion: 2.1 time: 0.100466 Sep 02 17:18:28.858043 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 644/1348] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:18:28 2021] POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action => generated 28185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:18:29.243352 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-6ace5141-cb80-47aa-a226-b7006ee2cde6 req-01f544c7-1ded-482e-8bc2-d696b29917b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "371ab7f3-5976-495e-90cb-d0e9035d8eb1", "name": "network-vif-plugged", "status": "completed", "tag": "31f557d1-9615-485b-967b-0c514ea54c30"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:29.245105 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:18:29.245105 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:18:29.254813 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-6ace5141-cb80-47aa-a226-b7006ee2cde6 req-01f544c7-1ded-482e-8bc2-d696b29917b0 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:29.255268 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-6ace5141-cb80-47aa-a226-b7006ee2cde6 req-01f544c7-1ded-482e-8bc2-d696b29917b0 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:29.266850 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-6ace5141-cb80-47aa-a226-b7006ee2cde6 req-01f544c7-1ded-482e-8bc2-d696b29917b0 service nova] Creating event network-vif-plugged:31f557d1-9615-485b-967b-0c514ea54c30 for instance 371ab7f3-5976-495e-90cb-d0e9035d8eb1 on hv-cinder-80626 Sep 02 17:18:29.271794 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-6ace5141-cb80-47aa-a226-b7006ee2cde6 req-01f544c7-1ded-482e-8bc2-d696b29917b0 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032041 Sep 02 17:18:29.272379 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 705/1349] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:18:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:18:29.366851 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-044ec7b5-0194-4fa8-b2b4-a2be9bbd7d3d tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:18:29.367505 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-044ec7b5-0194-4fa8-b2b4-a2be9bbd7d3d tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:29.374073 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-044ec7b5-0194-4fa8-b2b4-a2be9bbd7d3d tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:29.374554 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-044ec7b5-0194-4fa8-b2b4-a2be9bbd7d3d tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:29.375879 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-044ec7b5-0194-4fa8-b2b4-a2be9bbd7d3d tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:29.376321 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-044ec7b5-0194-4fa8-b2b4-a2be9bbd7d3d tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:29.502491 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-044ec7b5-0194-4fa8-b2b4-a2be9bbd7d3d tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afa61134d0457aa9f886c4bece5df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2001cfaa564496ba271b544cfdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:18:29.509641 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-044ec7b5-0194-4fa8-b2b4-a2be9bbd7d3d tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 200 len: 1358 microversion: 2.1 time: 0.147999 Sep 02 17:18:29.510204 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 645/1350] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:18:29 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:18:29.868298 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-d531a7eb-3b49-43cc-b23b-43bea8308685 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:29.869549 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-d531a7eb-3b49-43cc-b23b-43bea8308685 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:29.875616 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d531a7eb-3b49-43cc-b23b-43bea8308685 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:29.876195 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d531a7eb-3b49-43cc-b23b-43bea8308685 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:29.876992 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d531a7eb-3b49-43cc-b23b-43bea8308685 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:29.877420 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d531a7eb-3b49-43cc-b23b-43bea8308685 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:29.976452 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-d531a7eb-3b49-43cc-b23b-43bea8308685 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action" status: 200 len: 28475 microversion: 2.1 time: 0.112006 Sep 02 17:18:29.977109 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 706/1351] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:18:29 2021] POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action => generated 28475 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:18:30.526209 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-887b64c7-3ab9-448e-8d88-d9048d803e65 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:18:30.526758 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-887b64c7-3ab9-448e-8d88-d9048d803e65 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:30.533193 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-887b64c7-3ab9-448e-8d88-d9048d803e65 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:30.533632 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-887b64c7-3ab9-448e-8d88-d9048d803e65 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:30.534413 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-887b64c7-3ab9-448e-8d88-d9048d803e65 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:30.534875 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-887b64c7-3ab9-448e-8d88-d9048d803e65 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:30.654724 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-887b64c7-3ab9-448e-8d88-d9048d803e65 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afa61134d0457aa9f886c4bece5df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2001cfaa564496ba271b544cfdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:18:30.661785 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-887b64c7-3ab9-448e-8d88-d9048d803e65 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 200 len: 1358 microversion: 2.1 time: 0.139272 Sep 02 17:18:30.662326 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 646/1352] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:18:30 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 1358 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:18:30.988948 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-c21bf598-adb1-4831-a5aa-3a0250570c82 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:30.989929 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-c21bf598-adb1-4831-a5aa-3a0250570c82 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:30.996539 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c21bf598-adb1-4831-a5aa-3a0250570c82 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:30.996981 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c21bf598-adb1-4831-a5aa-3a0250570c82 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:30.997732 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c21bf598-adb1-4831-a5aa-3a0250570c82 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:30.998158 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c21bf598-adb1-4831-a5aa-3a0250570c82 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:31.079563 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-c21bf598-adb1-4831-a5aa-3a0250570c82 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action" status: 200 len: 28475 microversion: 2.1 time: 0.095056 Sep 02 17:18:31.080441 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 707/1353] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:18:30 2021] POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action => generated 28475 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:18:31.677888 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-00256c12-5fa4-4ebc-b197-3afe2a3560d2 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:18:31.678500 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-00256c12-5fa4-4ebc-b197-3afe2a3560d2 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:31.684413 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-00256c12-5fa4-4ebc-b197-3afe2a3560d2 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:31.684863 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-00256c12-5fa4-4ebc-b197-3afe2a3560d2 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:31.685625 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-00256c12-5fa4-4ebc-b197-3afe2a3560d2 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:31.686058 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-00256c12-5fa4-4ebc-b197-3afe2a3560d2 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:31.810373 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-00256c12-5fa4-4ebc-b197-3afe2a3560d2 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afa61134d0457aa9f886c4bece5df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2001cfaa564496ba271b544cfdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:18:31.818221 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-00256c12-5fa4-4ebc-b197-3afe2a3560d2 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 200 len: 1547 microversion: 2.1 time: 0.143987 Sep 02 17:18:31.818802 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 647/1354] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:18:31 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 1547 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:18:31.834154 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-7e4079cb-e70f-48db-ae80-68c7de326b15 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:18:31.834890 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-7e4079cb-e70f-48db-ae80-68c7de326b15 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:31.841282 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7e4079cb-e70f-48db-ae80-68c7de326b15 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:31.841733 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7e4079cb-e70f-48db-ae80-68c7de326b15 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:31.842533 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7e4079cb-e70f-48db-ae80-68c7de326b15 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:31.842993 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7e4079cb-e70f-48db-ae80-68c7de326b15 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:31.960828 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-7e4079cb-e70f-48db-ae80-68c7de326b15 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afa61134d0457aa9f886c4bece5df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2001cfaa564496ba271b544cfdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:18:31.968090 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-7e4079cb-e70f-48db-ae80-68c7de326b15 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 200 len: 1547 microversion: 2.1 time: 0.138001 Sep 02 17:18:31.968648 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 708/1355] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:18:31 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 1547 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:18:31.983165 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-fd601ad4-bce2-46a0-a825-5fc6ba903174 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:18:31.986985 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:18:31.986985 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: warnings.warn(msg) Sep 02 17:18:31.987965 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-fd601ad4-bce2-46a0-a825-5fc6ba903174 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '16afa61134d0457aa9f886c4bece5df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2001cfaa564496ba271b544cfdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:18:31.988701 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-fd601ad4-bce2-46a0-a825-5fc6ba903174 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Searching by: {'deleted': False, 'project_id': '6f2001cfaa564496ba271b544cfdc14f'} {{(pid=108417) get_all /opt/stack/nova/nova/compute/api.py:2904}} Sep 02 17:18:31.995280 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fd601ad4-bce2-46a0-a825-5fc6ba903174 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:31.995718 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fd601ad4-bce2-46a0-a825-5fc6ba903174 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:31.996505 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fd601ad4-bce2-46a0-a825-5fc6ba903174 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:31.996934 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-fd601ad4-bce2-46a0-a825-5fc6ba903174 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:32.091073 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-10cd7e42-57a6-4dc1-819f-712e53a07435 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:32.092011 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-10cd7e42-57a6-4dc1-819f-712e53a07435 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:32.095721 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.multi_cell_list [None req-fd601ad4-bce2-46a0-a825-5fc6ba903174 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=108417) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Sep 02 17:18:32.098455 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-10cd7e42-57a6-4dc1-819f-712e53a07435 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:32.101002 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-10cd7e42-57a6-4dc1-819f-712e53a07435 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:32.101785 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-10cd7e42-57a6-4dc1-819f-712e53a07435 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:32.102224 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-10cd7e42-57a6-4dc1-819f-712e53a07435 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:32.187378 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-fd601ad4-bce2-46a0-a825-5fc6ba903174 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.207640 Sep 02 17:18:32.187953 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 648/1356] 10.222.0.41 () {58 vars in 1125 bytes} [Thu Sep 2 17:18:31 2021] GET /compute/v2.1/servers => generated 343 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:18:32.197543 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-17524f5a-c23f-4749-99bb-2860c3a6986b tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:18:32.198172 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-17524f5a-c23f-4749-99bb-2860c3a6986b tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:32.198723 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-10cd7e42-57a6-4dc1-819f-712e53a07435 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action" status: 200 len: 28643 microversion: 2.1 time: 0.111077 Sep 02 17:18:32.202453 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 709/1357] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:18:32 2021] POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action => generated 28643 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:18:32.203885 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-17524f5a-c23f-4749-99bb-2860c3a6986b tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:32.204329 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-17524f5a-c23f-4749-99bb-2860c3a6986b tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:32.205079 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-17524f5a-c23f-4749-99bb-2860c3a6986b tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:32.205504 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-17524f5a-c23f-4749-99bb-2860c3a6986b tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:32.322332 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-17524f5a-c23f-4749-99bb-2860c3a6986b tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afa61134d0457aa9f886c4bece5df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2001cfaa564496ba271b544cfdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:18:32.329603 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-17524f5a-c23f-4749-99bb-2860c3a6986b tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 200 len: 1547 microversion: 2.1 time: 0.135426 Sep 02 17:18:32.330161 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 649/1358] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:18:32 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 1547 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:18:33.210569 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-9fadd906-0a39-4806-bd1b-1b3a7c0fd6b5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:33.211583 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-9fadd906-0a39-4806-bd1b-1b3a7c0fd6b5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:33.217989 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9fadd906-0a39-4806-bd1b-1b3a7c0fd6b5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:33.218420 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9fadd906-0a39-4806-bd1b-1b3a7c0fd6b5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:33.219214 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9fadd906-0a39-4806-bd1b-1b3a7c0fd6b5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:33.219657 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9fadd906-0a39-4806-bd1b-1b3a7c0fd6b5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:33.328313 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-9fadd906-0a39-4806-bd1b-1b3a7c0fd6b5 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action" status: 200 len: 28643 microversion: 2.1 time: 0.121648 Sep 02 17:18:33.328929 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 710/1359] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:18:33 2021] POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action => generated 28643 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:18:33.837650 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-1d162ff1-2959-46e7-bf2f-8e1fc20fb462 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27a4f6dc-41f1-4c50-9e5d-b96f41d0988a"}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:33.838821 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-1d162ff1-2959-46e7-bf2f-8e1fc20fb462 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:33.846131 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1d162ff1-2959-46e7-bf2f-8e1fc20fb462 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:33.846666 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1d162ff1-2959-46e7-bf2f-8e1fc20fb462 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:33.847479 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1d162ff1-2959-46e7-bf2f-8e1fc20fb462 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:33.847906 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1d162ff1-2959-46e7-bf2f-8e1fc20fb462 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:34.097148 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-1d162ff1-2959-46e7-bf2f-8e1fc20fb462 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "POST /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262072 Sep 02 17:18:34.097753 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 650/1360] 10.222.0.41 () {60 vars in 1323 bytes} [Thu Sep 2 17:18:33 2021] POST /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:18:34.339234 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-c6d3637a-39e8-4cc6-adec-939cab2434b7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:34.340304 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-c6d3637a-39e8-4cc6-adec-939cab2434b7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:34.347636 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c6d3637a-39e8-4cc6-adec-939cab2434b7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:34.348082 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c6d3637a-39e8-4cc6-adec-939cab2434b7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:34.348866 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c6d3637a-39e8-4cc6-adec-939cab2434b7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:34.349297 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c6d3637a-39e8-4cc6-adec-939cab2434b7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:34.450217 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-c6d3637a-39e8-4cc6-adec-939cab2434b7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action" status: 200 len: 28643 microversion: 2.1 time: 0.114758 Sep 02 17:18:34.450772 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 711/1361] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:18:34 2021] POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action => generated 28643 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:18:35.461567 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-64efe5db-7ca6-4a13-a8d3-36bf085c6ce8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:35.462479 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-64efe5db-7ca6-4a13-a8d3-36bf085c6ce8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:35.626601 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-64efe5db-7ca6-4a13-a8d3-36bf085c6ce8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:35.627056 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-64efe5db-7ca6-4a13-a8d3-36bf085c6ce8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:35.627828 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-64efe5db-7ca6-4a13-a8d3-36bf085c6ce8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:35.628248 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-64efe5db-7ca6-4a13-a8d3-36bf085c6ce8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:35.724030 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-64efe5db-7ca6-4a13-a8d3-36bf085c6ce8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action" status: 200 len: 28804 microversion: 2.1 time: 0.266322 Sep 02 17:18:35.724585 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 651/1362] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:18:35 2021] POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action => generated 28804 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:18:36.735902 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-18f6cd4e-eaa4-4781-a0be-0b4eaa39e558 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:36.736943 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-18f6cd4e-eaa4-4781-a0be-0b4eaa39e558 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:36.743399 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-18f6cd4e-eaa4-4781-a0be-0b4eaa39e558 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:36.744103 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-18f6cd4e-eaa4-4781-a0be-0b4eaa39e558 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:36.744854 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-18f6cd4e-eaa4-4781-a0be-0b4eaa39e558 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:36.745288 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-18f6cd4e-eaa4-4781-a0be-0b4eaa39e558 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:36.844932 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-18f6cd4e-eaa4-4781-a0be-0b4eaa39e558 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action" status: 200 len: 30733 microversion: 2.1 time: 0.112941 Sep 02 17:18:36.845523 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 712/1363] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:18:36 2021] POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action => generated 30733 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:18:37.856909 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-679bd59c-379b-4d31-81f4-f0e8e6e04fcb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:37.857906 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-679bd59c-379b-4d31-81f4-f0e8e6e04fcb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:37.864347 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-679bd59c-379b-4d31-81f4-f0e8e6e04fcb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:37.864795 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-679bd59c-379b-4d31-81f4-f0e8e6e04fcb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:37.865562 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-679bd59c-379b-4d31-81f4-f0e8e6e04fcb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:37.866013 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-679bd59c-379b-4d31-81f4-f0e8e6e04fcb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:37.973162 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-679bd59c-379b-4d31-81f4-f0e8e6e04fcb tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action" status: 200 len: 32371 microversion: 2.1 time: 0.120111 Sep 02 17:18:37.973768 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 652/1364] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:18:37 2021] POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action => generated 32371 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:18:38.986195 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-2e1ccdf0-ec4e-4531-bf15-fa29a9586ee3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:38.987211 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-2e1ccdf0-ec4e-4531-bf15-fa29a9586ee3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:38.994506 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2e1ccdf0-ec4e-4531-bf15-fa29a9586ee3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:38.994984 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2e1ccdf0-ec4e-4531-bf15-fa29a9586ee3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:38.995743 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2e1ccdf0-ec4e-4531-bf15-fa29a9586ee3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:38.996176 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2e1ccdf0-ec4e-4531-bf15-fa29a9586ee3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:39.093872 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-2e1ccdf0-ec4e-4531-bf15-fa29a9586ee3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action" status: 200 len: 33482 microversion: 2.1 time: 0.111573 Sep 02 17:18:39.094485 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 713/1365] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:18:38 2021] POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action => generated 33482 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:18:40.105761 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-7fa37542-7adc-49b9-b706-eab3f81b2f99 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:40.106804 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-7fa37542-7adc-49b9-b706-eab3f81b2f99 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:40.113273 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7fa37542-7adc-49b9-b706-eab3f81b2f99 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:40.113722 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7fa37542-7adc-49b9-b706-eab3f81b2f99 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:40.114485 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7fa37542-7adc-49b9-b706-eab3f81b2f99 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:40.114952 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7fa37542-7adc-49b9-b706-eab3f81b2f99 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:40.219556 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-7fa37542-7adc-49b9-b706-eab3f81b2f99 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action" status: 200 len: 34347 microversion: 2.1 time: 0.117742 Sep 02 17:18:40.220161 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 653/1366] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:18:40 2021] POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action => generated 34347 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:18:41.230953 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-88196a95-e115-43d5-8c9f-bba00dd27d6f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:41.231947 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-88196a95-e115-43d5-8c9f-bba00dd27d6f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:41.239107 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-88196a95-e115-43d5-8c9f-bba00dd27d6f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:41.239571 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-88196a95-e115-43d5-8c9f-bba00dd27d6f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:41.240344 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-88196a95-e115-43d5-8c9f-bba00dd27d6f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:41.240779 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-88196a95-e115-43d5-8c9f-bba00dd27d6f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:41.331466 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-88196a95-e115-43d5-8c9f-bba00dd27d6f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action" status: 200 len: 35307 microversion: 2.1 time: 0.104461 Sep 02 17:18:41.332574 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 714/1367] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:18:41 2021] POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action => generated 35307 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:18:41.661021 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-f902fadb-67e8-4dc4-b301-1e37b97edfe8 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:18:41.662004 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-f902fadb-67e8-4dc4-b301-1e37b97edfe8 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:41.668482 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f902fadb-67e8-4dc4-b301-1e37b97edfe8 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:41.668966 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f902fadb-67e8-4dc4-b301-1e37b97edfe8 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:41.669725 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f902fadb-67e8-4dc4-b301-1e37b97edfe8 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:41.670158 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-f902fadb-67e8-4dc4-b301-1e37b97edfe8 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:41.936479 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-f902fadb-67e8-4dc4-b301-1e37b97edfe8 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afa61134d0457aa9f886c4bece5df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2001cfaa564496ba271b544cfdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:18:41.946554 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-f902fadb-67e8-4dc4-b301-1e37b97edfe8 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 200 len: 1593 microversion: 2.1 time: 0.290177 Sep 02 17:18:41.947148 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 654/1368] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:18:41 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 1593 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:18:42.344100 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-c3bc7cab-1c0c-48ee-84d1-4b33afa4ca50 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:42.345094 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-c3bc7cab-1c0c-48ee-84d1-4b33afa4ca50 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:42.351539 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c3bc7cab-1c0c-48ee-84d1-4b33afa4ca50 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:42.351983 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c3bc7cab-1c0c-48ee-84d1-4b33afa4ca50 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:42.352741 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c3bc7cab-1c0c-48ee-84d1-4b33afa4ca50 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:42.353173 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c3bc7cab-1c0c-48ee-84d1-4b33afa4ca50 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:42.447114 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-c3bc7cab-1c0c-48ee-84d1-4b33afa4ca50 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action" status: 200 len: 36696 microversion: 2.1 time: 0.106813 Sep 02 17:18:42.451726 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 715/1369] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:18:42 2021] POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action => generated 36696 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:18:43.459956 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-1544578e-17b8-434c-bf37-2eb0fe19189b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:43.460907 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-1544578e-17b8-434c-bf37-2eb0fe19189b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:43.467136 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1544578e-17b8-434c-bf37-2eb0fe19189b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:43.467583 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1544578e-17b8-434c-bf37-2eb0fe19189b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:43.468358 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1544578e-17b8-434c-bf37-2eb0fe19189b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:43.468795 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-1544578e-17b8-434c-bf37-2eb0fe19189b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:43.560076 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-1544578e-17b8-434c-bf37-2eb0fe19189b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action" status: 200 len: 38037 microversion: 2.1 time: 0.104212 Sep 02 17:18:43.560870 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 655/1370] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:18:43 2021] POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action => generated 38037 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:18:43.604270 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-34d6955c-188e-4da4-a9b8-479495a04cdc req-1e0fdf8d-4563-494d-9cfc-f695f7b49e21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "371ab7f3-5976-495e-90cb-d0e9035d8eb1", "tag": "31f557d1-9615-485b-967b-0c514ea54c30"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:43.605713 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:18:43.605713 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:18:43.613078 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-34d6955c-188e-4da4-a9b8-479495a04cdc req-1e0fdf8d-4563-494d-9cfc-f695f7b49e21 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:43.614016 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-34d6955c-188e-4da4-a9b8-479495a04cdc req-1e0fdf8d-4563-494d-9cfc-f695f7b49e21 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:43.625267 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-34d6955c-188e-4da4-a9b8-479495a04cdc req-1e0fdf8d-4563-494d-9cfc-f695f7b49e21 service nova] Creating event network-changed:31f557d1-9615-485b-967b-0c514ea54c30 for instance 371ab7f3-5976-495e-90cb-d0e9035d8eb1 on hv-cinder-80626 Sep 02 17:18:43.630715 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-34d6955c-188e-4da4-a9b8-479495a04cdc req-1e0fdf8d-4563-494d-9cfc-f695f7b49e21 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030315 Sep 02 17:18:43.631464 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 716/1371] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:18:43 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:18:44.572763 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-24335882-1207-4796-afe5-82f120b2a521 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:44.573796 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-24335882-1207-4796-afe5-82f120b2a521 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:44.580678 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-24335882-1207-4796-afe5-82f120b2a521 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:44.581362 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-24335882-1207-4796-afe5-82f120b2a521 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:44.582704 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-24335882-1207-4796-afe5-82f120b2a521 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:44.583521 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-24335882-1207-4796-afe5-82f120b2a521 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:44.647582 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-7f18c98d-0f4b-4e1d-9e52-bf6e050dbc2c tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-163242033"}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:44.648203 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-7f18c98d-0f4b-4e1d-9e52-bf6e050dbc2c tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:44.654445 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7f18c98d-0f4b-4e1d-9e52-bf6e050dbc2c tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:44.654999 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7f18c98d-0f4b-4e1d-9e52-bf6e050dbc2c tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:44.655769 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7f18c98d-0f4b-4e1d-9e52-bf6e050dbc2c tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:44.656198 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7f18c98d-0f4b-4e1d-9e52-bf6e050dbc2c tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:44.687808 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-24335882-1207-4796-afe5-82f120b2a521 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action" status: 200 len: 38171 microversion: 2.1 time: 0.118870 Sep 02 17:18:44.688606 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 656/1372] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:18:44 2021] POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action => generated 38171 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:18:44.829105 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.network.security_group_api [None req-7f18c98d-0f4b-4e1d-9e52-bf6e050dbc2c tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Adding security group 967935ff-cfd4-48e0-9395-c819e4ad235e to port 31f557d1-9615-485b-967b-0c514ea54c30 Sep 02 17:18:45.163729 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-7f18c98d-0f4b-4e1d-9e52-bf6e050dbc2c tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "POST /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1/action" status: 202 len: 0 microversion: 2.1 time: 0.521243 Sep 02 17:18:45.164324 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 717/1373] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:18:44 2021] POST /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1/action => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:18:45.181493 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-b3fb116e-e74b-479a-b434-467f87aa1f2e tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:18:45.184459 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-b3fb116e-e74b-479a-b434-467f87aa1f2e tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:45.190832 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-506e67d2-e4db-4493-aad8-5ed9ac932c16 req-ff2da534-1224-4b09-bce9-ac34c291ab7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "371ab7f3-5976-495e-90cb-d0e9035d8eb1", "tag": "31f557d1-9615-485b-967b-0c514ea54c30"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:45.197494 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:18:45.197494 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:18:45.199695 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b3fb116e-e74b-479a-b434-467f87aa1f2e tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:45.200211 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b3fb116e-e74b-479a-b434-467f87aa1f2e tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:45.201313 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b3fb116e-e74b-479a-b434-467f87aa1f2e tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:45.201888 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b3fb116e-e74b-479a-b434-467f87aa1f2e tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:45.207571 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-506e67d2-e4db-4493-aad8-5ed9ac932c16 req-ff2da534-1224-4b09-bce9-ac34c291ab7b service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:45.208317 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-506e67d2-e4db-4493-aad8-5ed9ac932c16 req-ff2da534-1224-4b09-bce9-ac34c291ab7b service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:45.221538 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-506e67d2-e4db-4493-aad8-5ed9ac932c16 req-ff2da534-1224-4b09-bce9-ac34c291ab7b service nova] Creating event network-changed:31f557d1-9615-485b-967b-0c514ea54c30 for instance 371ab7f3-5976-495e-90cb-d0e9035d8eb1 on hv-cinder-80626 Sep 02 17:18:45.229232 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-506e67d2-e4db-4493-aad8-5ed9ac932c16 req-ff2da534-1224-4b09-bce9-ac34c291ab7b service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052709 Sep 02 17:18:45.230553 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 718/1374] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:18:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:18:45.371851 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-b3fb116e-e74b-479a-b434-467f87aa1f2e tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afa61134d0457aa9f886c4bece5df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2001cfaa564496ba271b544cfdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:18:45.383854 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-b3fb116e-e74b-479a-b434-467f87aa1f2e tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 200 len: 1757 microversion: 2.1 time: 0.212616 Sep 02 17:18:45.386514 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 657/1375] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:18:45 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 1757 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:18:45.700232 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-976aac0c-0aa6-4248-8687-baabc3e5ea79 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:45.701219 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-976aac0c-0aa6-4248-8687-baabc3e5ea79 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:45.707192 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-976aac0c-0aa6-4248-8687-baabc3e5ea79 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:45.707634 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-976aac0c-0aa6-4248-8687-baabc3e5ea79 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:45.708401 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-976aac0c-0aa6-4248-8687-baabc3e5ea79 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:45.708827 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-976aac0c-0aa6-4248-8687-baabc3e5ea79 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:45.806999 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-976aac0c-0aa6-4248-8687-baabc3e5ea79 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action" status: 200 len: 38171 microversion: 2.1 time: 0.110711 Sep 02 17:18:45.807802 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 719/1376] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:18:45 2021] POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action => generated 38171 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 02 17:18:46.819318 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-2c8e26b2-3cc8-4bcc-9d12-e64058a2e4a9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:46.820318 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-2c8e26b2-3cc8-4bcc-9d12-e64058a2e4a9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:46.826872 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2c8e26b2-3cc8-4bcc-9d12-e64058a2e4a9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:46.827322 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2c8e26b2-3cc8-4bcc-9d12-e64058a2e4a9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:46.828110 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2c8e26b2-3cc8-4bcc-9d12-e64058a2e4a9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:46.828542 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2c8e26b2-3cc8-4bcc-9d12-e64058a2e4a9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:46.921786 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-2c8e26b2-3cc8-4bcc-9d12-e64058a2e4a9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action" status: 200 len: 38171 microversion: 2.1 time: 0.106623 Sep 02 17:18:46.922414 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 658/1377] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:18:46 2021] POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action => generated 38171 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:18:47.934418 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-da6cd926-b416-4d5c-bb83-00aa17e75231 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:47.935434 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-da6cd926-b416-4d5c-bb83-00aa17e75231 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:47.943364 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-da6cd926-b416-4d5c-bb83-00aa17e75231 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:47.943810 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-da6cd926-b416-4d5c-bb83-00aa17e75231 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:47.944569 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-da6cd926-b416-4d5c-bb83-00aa17e75231 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:47.945030 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-da6cd926-b416-4d5c-bb83-00aa17e75231 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:48.041672 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-da6cd926-b416-4d5c-bb83-00aa17e75231 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action" status: 200 len: 38300 microversion: 2.1 time: 0.111124 Sep 02 17:18:48.042291 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 720/1378] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:18:47 2021] POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/action => generated 38300 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 02 17:18:48.052879 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-3a79a543-d05b-4ab7-8033-ccb99ed2a0f9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:18:48.053454 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-3a79a543-d05b-4ab7-8033-ccb99ed2a0f9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:48.060052 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3a79a543-d05b-4ab7-8033-ccb99ed2a0f9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:48.060517 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3a79a543-d05b-4ab7-8033-ccb99ed2a0f9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:48.061272 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3a79a543-d05b-4ab7-8033-ccb99ed2a0f9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:48.061698 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-3a79a543-d05b-4ab7-8033-ccb99ed2a0f9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:48.084375 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-3a79a543-d05b-4ab7-8033-ccb99ed2a0f9 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/ips" status: 200 len: 146 microversion: 2.1 time: 0.035986 Sep 02 17:18:48.084908 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 659/1379] 10.222.0.41 () {58 vars in 1248 bytes} [Thu Sep 2 17:18:48 2021] GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:18:49.391133 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-f24b3224-980a-43c6-a6ba-27e9b54857ab tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a897d5af-4db6-4e19-84d1-8bd63c27de2b"}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:49.392258 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-f24b3224-980a-43c6-a6ba-27e9b54857ab tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:49.399235 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f24b3224-980a-43c6-a6ba-27e9b54857ab tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:49.399679 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f24b3224-980a-43c6-a6ba-27e9b54857ab tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:49.400427 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f24b3224-980a-43c6-a6ba-27e9b54857ab tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:49.400853 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-f24b3224-980a-43c6-a6ba-27e9b54857ab tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:49.658068 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-f24b3224-980a-43c6-a6ba-27e9b54857ab tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270907 Sep 02 17:18:49.658803 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 721/1380] 10.222.0.41 () {60 vars in 1323 bytes} [Thu Sep 2 17:18:49 2021] POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:18:51.067631 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 17:18:51.068254 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: Thu Sep 2 17:18:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 02 17:18:57.342929 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-65da4c6b-5319-4ee1-835b-7778555bc244 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:18:57.343834 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-65da4c6b-5319-4ee1-835b-7778555bc244 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:57.350179 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-65da4c6b-5319-4ee1-835b-7778555bc244 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:57.350712 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-65da4c6b-5319-4ee1-835b-7778555bc244 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:57.351421 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-65da4c6b-5319-4ee1-835b-7778555bc244 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:57.351850 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-65da4c6b-5319-4ee1-835b-7778555bc244 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:57.381151 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-65da4c6b-5319-4ee1-835b-7778555bc244 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042004 Sep 02 17:18:57.381620 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 660/1381] 10.222.0.41 () {58 vars in 1302 bytes} [Thu Sep 2 17:18:57 2021] GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:18:57.392114 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-364abf08-2c1d-4491-b514-d9b852517c47 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:18:57.392696 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-364abf08-2c1d-4491-b514-d9b852517c47 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:57.399546 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-364abf08-2c1d-4491-b514-d9b852517c47 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:57.399996 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-364abf08-2c1d-4491-b514-d9b852517c47 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:57.400760 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-364abf08-2c1d-4491-b514-d9b852517c47 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:57.401196 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-364abf08-2c1d-4491-b514-d9b852517c47 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:57.429214 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-364abf08-2c1d-4491-b514-d9b852517c47 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/os-volume_attachments/a897d5af-4db6-4e19-84d1-8bd63c27de2b" status: 200 len: 194 microversion: 2.1 time: 0.041720 Sep 02 17:18:57.429763 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 722/1382] 10.222.0.41 () {58 vars in 1413 bytes} [Thu Sep 2 17:18:57 2021] GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/os-volume_attachments/a897d5af-4db6-4e19-84d1-8bd63c27de2b => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:18:58.733082 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-ba072604-0214-42cf-a5dc-71d0be2771e7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b707438-f97a-472f-8744-9eba35b6d707"}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:18:58.734238 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-ba072604-0214-42cf-a5dc-71d0be2771e7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:18:58.740445 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ba072604-0214-42cf-a5dc-71d0be2771e7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:58.740878 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ba072604-0214-42cf-a5dc-71d0be2771e7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:58.741619 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ba072604-0214-42cf-a5dc-71d0be2771e7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:18:58.742037 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-ba072604-0214-42cf-a5dc-71d0be2771e7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:18:59.000019 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-ba072604-0214-42cf-a5dc-71d0be2771e7 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270433 Sep 02 17:18:59.000547 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 661/1383] 10.222.0.41 () {60 vars in 1323 bytes} [Thu Sep 2 17:18:58 2021] POST /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:19:06.495673 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-9f783ac3-b9b3-4d29-b0f0-c1b5d546b13f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:06.496576 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-9f783ac3-b9b3-4d29-b0f0-c1b5d546b13f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:19:06.502809 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9f783ac3-b9b3-4d29-b0f0-c1b5d546b13f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:06.503258 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9f783ac3-b9b3-4d29-b0f0-c1b5d546b13f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:06.504016 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9f783ac3-b9b3-4d29-b0f0-c1b5d546b13f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:06.504948 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-9f783ac3-b9b3-4d29-b0f0-c1b5d546b13f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:06.533756 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-9f783ac3-b9b3-4d29-b0f0-c1b5d546b13f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042105 Sep 02 17:19:06.534283 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 723/1384] 10.222.0.41 () {58 vars in 1302 bytes} [Thu Sep 2 17:19:06 2021] GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/os-volume_attachments => generated 371 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:19:06.753204 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-e32a3d2f-71a8-4a87-9248-c8165e9a1295 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:06.753723 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-e32a3d2f-71a8-4a87-9248-c8165e9a1295 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:19:06.760449 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e32a3d2f-71a8-4a87-9248-c8165e9a1295 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:06.760888 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e32a3d2f-71a8-4a87-9248-c8165e9a1295 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:06.761637 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e32a3d2f-71a8-4a87-9248-c8165e9a1295 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:06.762062 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e32a3d2f-71a8-4a87-9248-c8165e9a1295 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:06.790017 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-e32a3d2f-71a8-4a87-9248-c8165e9a1295 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/os-volume_attachments/a897d5af-4db6-4e19-84d1-8bd63c27de2b" status: 200 len: 194 microversion: 2.1 time: 0.041561 Sep 02 17:19:06.790552 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 662/1385] 10.222.0.41 () {58 vars in 1413 bytes} [Thu Sep 2 17:19:06 2021] GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/os-volume_attachments/a897d5af-4db6-4e19-84d1-8bd63c27de2b => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:19:06.799604 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-7d1a374d-97f0-4267-8683-61eb3f3b2607 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:06.800102 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-7d1a374d-97f0-4267-8683-61eb3f3b2607 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:19:06.805827 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7d1a374d-97f0-4267-8683-61eb3f3b2607 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:06.806277 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7d1a374d-97f0-4267-8683-61eb3f3b2607 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:06.807071 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7d1a374d-97f0-4267-8683-61eb3f3b2607 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:06.807506 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7d1a374d-97f0-4267-8683-61eb3f3b2607 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:06.888706 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.objects.instance [None req-7d1a374d-97f0-4267-8683-61eb3f3b2607 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lazy-loading 'services' on Instance uuid ea9c64d9-b562-4bb6-88a2-88434835b7c8 {{(pid=108418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 17:19:07.100109 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-7d1a374d-97f0-4267-8683-61eb3f3b2607 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "DELETE /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/os-volume_attachments/a897d5af-4db6-4e19-84d1-8bd63c27de2b" status: 202 len: 0 microversion: 2.1 time: 0.303829 Sep 02 17:19:07.100681 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 724/1386] 10.222.0.41 () {58 vars in 1416 bytes} [Thu Sep 2 17:19:06 2021] DELETE /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/os-volume_attachments/a897d5af-4db6-4e19-84d1-8bd63c27de2b => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:19:09.276009 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-371f3950-ffac-4825-b417-726149099d43 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:09.276485 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-371f3950-ffac-4825-b417-726149099d43 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:19:09.282615 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-371f3950-ffac-4825-b417-726149099d43 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:09.283085 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-371f3950-ffac-4825-b417-726149099d43 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:09.283838 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-371f3950-ffac-4825-b417-726149099d43 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:09.284262 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-371f3950-ffac-4825-b417-726149099d43 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:09.311828 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-371f3950-ffac-4825-b417-726149099d43 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/os-volume_attachments/7b707438-f97a-472f-8744-9eba35b6d707" status: 200 len: 194 microversion: 2.1 time: 0.039604 Sep 02 17:19:09.312377 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 663/1387] 10.222.0.41 () {58 vars in 1413 bytes} [Thu Sep 2 17:19:09 2021] GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/os-volume_attachments/7b707438-f97a-472f-8744-9eba35b6d707 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:19:09.322149 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-52bf0b39-6ed7-4bbc-bf50-53dfdbdf0887 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:09.322754 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-52bf0b39-6ed7-4bbc-bf50-53dfdbdf0887 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:19:09.328803 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-52bf0b39-6ed7-4bbc-bf50-53dfdbdf0887 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:09.329246 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-52bf0b39-6ed7-4bbc-bf50-53dfdbdf0887 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:09.330003 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-52bf0b39-6ed7-4bbc-bf50-53dfdbdf0887 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:09.330436 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-52bf0b39-6ed7-4bbc-bf50-53dfdbdf0887 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:09.412578 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.objects.instance [None req-52bf0b39-6ed7-4bbc-bf50-53dfdbdf0887 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lazy-loading 'services' on Instance uuid ea9c64d9-b562-4bb6-88a2-88434835b7c8 {{(pid=108418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 17:19:09.475275 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-52bf0b39-6ed7-4bbc-bf50-53dfdbdf0887 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "DELETE /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/os-volume_attachments/7b707438-f97a-472f-8744-9eba35b6d707" status: 202 len: 0 microversion: 2.1 time: 0.156970 Sep 02 17:19:09.475837 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 725/1388] 10.222.0.41 () {58 vars in 1416 bytes} [Thu Sep 2 17:19:09 2021] DELETE /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/os-volume_attachments/7b707438-f97a-472f-8744-9eba35b6d707 => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:19:10.064646 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-83a6a1e3-0003-4ee7-934c-4671029c77ab tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:19:10.065595 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-83a6a1e3-0003-4ee7-934c-4671029c77ab tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:19:10.072862 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-83a6a1e3-0003-4ee7-934c-4671029c77ab tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:10.073319 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-83a6a1e3-0003-4ee7-934c-4671029c77ab tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:10.074091 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-83a6a1e3-0003-4ee7-934c-4671029c77ab tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:10.074531 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-83a6a1e3-0003-4ee7-934c-4671029c77ab tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:10.149179 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-83a6a1e3-0003-4ee7-934c-4671029c77ab tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "POST /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1/action" status: 202 len: 0 microversion: 2.1 time: 0.088055 Sep 02 17:19:10.150020 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 664/1389] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:19:10 2021] POST /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:19:10.158108 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-8b8982fc-16fb-4234-a826-a44c5691ac88 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:10.158917 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-8b8982fc-16fb-4234-a826-a44c5691ac88 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:19:10.165730 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8b8982fc-16fb-4234-a826-a44c5691ac88 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:10.166327 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8b8982fc-16fb-4234-a826-a44c5691ac88 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:10.167203 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8b8982fc-16fb-4234-a826-a44c5691ac88 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:10.167742 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8b8982fc-16fb-4234-a826-a44c5691ac88 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:10.307265 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-8b8982fc-16fb-4234-a826-a44c5691ac88 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afa61134d0457aa9f886c4bece5df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2001cfaa564496ba271b544cfdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:19:10.315445 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-8b8982fc-16fb-4234-a826-a44c5691ac88 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 200 len: 1749 microversion: 2.1 time: 0.161284 Sep 02 17:19:10.315996 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 726/1390] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:19:10 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 1749 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:19:10.644477 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-8bc2f688-63b1-41b8-90e9-fb5e8c072b3f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:10.645986 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-8bc2f688-63b1-41b8-90e9-fb5e8c072b3f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:19:10.652315 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8bc2f688-63b1-41b8-90e9-fb5e8c072b3f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:10.652953 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8bc2f688-63b1-41b8-90e9-fb5e8c072b3f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:10.653916 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8bc2f688-63b1-41b8-90e9-fb5e8c072b3f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:10.654516 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8bc2f688-63b1-41b8-90e9-fb5e8c072b3f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:10.685076 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-8bc2f688-63b1-41b8-90e9-fb5e8c072b3f tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044657 Sep 02 17:19:10.686027 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 665/1391] 10.222.0.41 () {58 vars in 1302 bytes} [Thu Sep 2 17:19:10 2021] GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 17:19:10.794495 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-8db4c488-54b0-42cd-b981-f3342eab3f11 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:10.795497 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-8db4c488-54b0-42cd-b981-f3342eab3f11 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:19:10.801734 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8db4c488-54b0-42cd-b981-f3342eab3f11 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:10.802179 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8db4c488-54b0-42cd-b981-f3342eab3f11 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:10.802976 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8db4c488-54b0-42cd-b981-f3342eab3f11 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:10.803415 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8db4c488-54b0-42cd-b981-f3342eab3f11 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:10.831280 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-8db4c488-54b0-42cd-b981-f3342eab3f11 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040440 Sep 02 17:19:10.831820 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 727/1392] 10.222.0.41 () {58 vars in 1302 bytes} [Thu Sep 2 17:19:10 2021] GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 17:19:10.890425 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-da87cab5-4ee9-4f90-bdd3-a4d825f56825 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:10.890945 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-da87cab5-4ee9-4f90-bdd3-a4d825f56825 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:19:10.897281 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-da87cab5-4ee9-4f90-bdd3-a4d825f56825 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:10.897749 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-da87cab5-4ee9-4f90-bdd3-a4d825f56825 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:10.898503 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-da87cab5-4ee9-4f90-bdd3-a4d825f56825 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:10.898968 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-da87cab5-4ee9-4f90-bdd3-a4d825f56825 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:10.923577 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-da87cab5-4ee9-4f90-bdd3-a4d825f56825 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Going to try to terminate instance {{(pid=108417) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 17:19:10.997482 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-da87cab5-4ee9-4f90-bdd3-a4d825f56825 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "DELETE /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8" status: 204 len: 0 microversion: 2.1 time: 0.110415 Sep 02 17:19:10.998164 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 666/1393] 10.222.0.41 () {58 vars in 1239 bytes} [Thu Sep 2 17:19:10 2021] DELETE /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 17:19:11.007879 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-e6adc225-9479-47b8-a828-f4a835385db8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:11.008485 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-e6adc225-9479-47b8-a828-f4a835385db8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:19:11.015719 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e6adc225-9479-47b8-a828-f4a835385db8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:11.016085 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e6adc225-9479-47b8-a828-f4a835385db8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:11.016856 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e6adc225-9479-47b8-a828-f4a835385db8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:11.017291 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e6adc225-9479-47b8-a828-f4a835385db8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:11.137337 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-e6adc225-9479-47b8-a828-f4a835385db8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:19:11.144630 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-e6adc225-9479-47b8-a828-f4a835385db8 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8" status: 200 len: 1672 microversion: 2.1 time: 0.141152 Sep 02 17:19:11.145182 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 728/1394] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:19:11 2021] GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8 => generated 1672 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:19:11.333396 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-c33f103c-b46a-48c9-a846-58ff42cbcff3 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:11.334091 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-c33f103c-b46a-48c9-a846-58ff42cbcff3 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:19:11.339911 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c33f103c-b46a-48c9-a846-58ff42cbcff3 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:11.340350 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c33f103c-b46a-48c9-a846-58ff42cbcff3 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:11.341100 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c33f103c-b46a-48c9-a846-58ff42cbcff3 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:11.341527 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-c33f103c-b46a-48c9-a846-58ff42cbcff3 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:11.474145 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-c33f103c-b46a-48c9-a846-58ff42cbcff3 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afa61134d0457aa9f886c4bece5df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2001cfaa564496ba271b544cfdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:19:11.481882 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-c33f103c-b46a-48c9-a846-58ff42cbcff3 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 200 len: 1754 microversion: 2.1 time: 0.153007 Sep 02 17:19:11.482446 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 667/1395] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:19:11 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:19:12.161760 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-e06a3bd9-1b23-42b5-9a16-5eef14375928 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:12.162354 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-e06a3bd9-1b23-42b5-9a16-5eef14375928 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:19:12.168280 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e06a3bd9-1b23-42b5-9a16-5eef14375928 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:12.168732 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e06a3bd9-1b23-42b5-9a16-5eef14375928 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:12.169502 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e06a3bd9-1b23-42b5-9a16-5eef14375928 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:12.169936 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e06a3bd9-1b23-42b5-9a16-5eef14375928 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:12.287422 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-e06a3bd9-1b23-42b5-9a16-5eef14375928 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:19:12.294724 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-e06a3bd9-1b23-42b5-9a16-5eef14375928 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8" status: 200 len: 1672 microversion: 2.1 time: 0.136738 Sep 02 17:19:12.295276 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 729/1396] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:19:12 2021] GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8 => generated 1672 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:19:12.498328 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-6dc542ed-a95d-4ca0-a2a7-c5d64337cee3 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:12.498893 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-6dc542ed-a95d-4ca0-a2a7-c5d64337cee3 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:19:12.504566 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6dc542ed-a95d-4ca0-a2a7-c5d64337cee3 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:12.505005 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6dc542ed-a95d-4ca0-a2a7-c5d64337cee3 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:12.505788 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6dc542ed-a95d-4ca0-a2a7-c5d64337cee3 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:12.506241 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6dc542ed-a95d-4ca0-a2a7-c5d64337cee3 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:12.624437 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-6dc542ed-a95d-4ca0-a2a7-c5d64337cee3 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afa61134d0457aa9f886c4bece5df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2001cfaa564496ba271b544cfdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:19:12.632539 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-6dc542ed-a95d-4ca0-a2a7-c5d64337cee3 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 200 len: 1754 microversion: 2.1 time: 0.138169 Sep 02 17:19:12.633096 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 668/1397] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:19:12 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 1754 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:19:13.312050 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-dc43b41a-151a-4951-9872-b75f176eab7e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:13.312658 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-dc43b41a-151a-4951-9872-b75f176eab7e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:19:13.318954 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-dc43b41a-151a-4951-9872-b75f176eab7e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:13.319434 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-dc43b41a-151a-4951-9872-b75f176eab7e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:13.320200 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-dc43b41a-151a-4951-9872-b75f176eab7e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:13.320639 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-dc43b41a-151a-4951-9872-b75f176eab7e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:13.572690 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-dc43b41a-151a-4951-9872-b75f176eab7e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9a77763fb724542a66e1d5f79f630f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb6337b5a3548bcad9fd236c619842d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:19:13.579905 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-dc43b41a-151a-4951-9872-b75f176eab7e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8" status: 200 len: 1672 microversion: 2.1 time: 0.271597 Sep 02 17:19:13.580459 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 730/1398] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:19:13 2021] GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8 => generated 1672 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:19:13.649119 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-b0521cbb-3758-4303-a6c1-53cb628b5f5b tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:13.650226 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-b0521cbb-3758-4303-a6c1-53cb628b5f5b tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:19:13.656441 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b0521cbb-3758-4303-a6c1-53cb628b5f5b tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:13.656897 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b0521cbb-3758-4303-a6c1-53cb628b5f5b tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:13.657663 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b0521cbb-3758-4303-a6c1-53cb628b5f5b tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:13.658103 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b0521cbb-3758-4303-a6c1-53cb628b5f5b tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:13.790484 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-b0521cbb-3758-4303-a6c1-53cb628b5f5b tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afa61134d0457aa9f886c4bece5df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2001cfaa564496ba271b544cfdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:19:13.798329 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-b0521cbb-3758-4303-a6c1-53cb628b5f5b tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 200 len: 1754 microversion: 2.1 time: 0.152895 Sep 02 17:19:13.798919 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 669/1399] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:19:13 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:19:14.015522 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-4847e80f-a32e-4d38-954a-cd18b0a90167 req-0a37fbaf-787e-4cc2-b3eb-ddba7de741b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea9c64d9-b562-4bb6-88a2-88434835b7c8", "name": "network-vif-deleted", "tag": "3425a5d0-ec45-4ecb-8ce4-10ea503dba12"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:19:14.017483 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:19:14.017483 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:19:14.024647 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-4847e80f-a32e-4d38-954a-cd18b0a90167 req-0a37fbaf-787e-4cc2-b3eb-ddba7de741b4 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:14.025211 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-4847e80f-a32e-4d38-954a-cd18b0a90167 req-0a37fbaf-787e-4cc2-b3eb-ddba7de741b4 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:14.036858 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-4847e80f-a32e-4d38-954a-cd18b0a90167 req-0a37fbaf-787e-4cc2-b3eb-ddba7de741b4 service nova] Creating event network-vif-deleted:3425a5d0-ec45-4ecb-8ce4-10ea503dba12 for instance ea9c64d9-b562-4bb6-88a2-88434835b7c8 on hv-cinder-80626 Sep 02 17:19:14.042401 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-4847e80f-a32e-4d38-954a-cd18b0a90167 req-0a37fbaf-787e-4cc2-b3eb-ddba7de741b4 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030295 Sep 02 17:19:14.043659 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 731/1400] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:19:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:19:14.596463 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-8d22245d-77ab-45da-90ff-aa24c4f42334 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:14.597414 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-8d22245d-77ab-45da-90ff-aa24c4f42334 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:19:14.603398 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8d22245d-77ab-45da-90ff-aa24c4f42334 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:14.604102 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8d22245d-77ab-45da-90ff-aa24c4f42334 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:14.605211 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8d22245d-77ab-45da-90ff-aa24c4f42334 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:14.605763 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-8d22245d-77ab-45da-90ff-aa24c4f42334 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:14.619895 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.wsgi [None req-8d22245d-77ab-45da-90ff-aa24c4f42334 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] HTTP exception thrown: Instance ea9c64d9-b562-4bb6-88a2-88434835b7c8 could not be found. Sep 02 17:19:14.620484 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-8d22245d-77ab-45da-90ff-aa24c4f42334 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Returning 404 to user: Instance ea9c64d9-b562-4bb6-88a2-88434835b7c8 could not be found. {{(pid=108417) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:19:14.621308 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-8d22245d-77ab-45da-90ff-aa24c4f42334 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8" status: 404 len: 111 microversion: 2.1 time: 0.028855 Sep 02 17:19:14.621839 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 670/1401] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:19:14 2021] GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 17:19:14.631452 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-968fd4c3-7de7-48df-97c8-4ab261e32f27 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '.version_select at 0x7fca9d1d51f0>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:14.654206 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-968fd4c3-7de7-48df-97c8-4ab261e32f27 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-999501011" status: 202 len: 0 microversion: 2.1 time: 0.027637 Sep 02 17:19:14.654917 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 732/1402] 10.222.0.41 () {58 vars in 1218 bytes} [Thu Sep 2 17:19:14 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-999501011 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:19:14.826239 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-6e9ef0f9-6f55-4c80-be9f-cf7c4598d4d8 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:14.826239 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-6e9ef0f9-6f55-4c80-be9f-cf7c4598d4d8 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:19:14.831592 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6e9ef0f9-6f55-4c80-be9f-cf7c4598d4d8 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:14.832042 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6e9ef0f9-6f55-4c80-be9f-cf7c4598d4d8 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:14.832861 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6e9ef0f9-6f55-4c80-be9f-cf7c4598d4d8 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:14.833303 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-6e9ef0f9-6f55-4c80-be9f-cf7c4598d4d8 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:14.972667 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-6e9ef0f9-6f55-4c80-be9f-cf7c4598d4d8 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afa61134d0457aa9f886c4bece5df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2001cfaa564496ba271b544cfdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:19:14.981220 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-6e9ef0f9-6f55-4c80-be9f-cf7c4598d4d8 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 200 len: 1754 microversion: 2.1 time: 0.165010 Sep 02 17:19:14.981787 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 671/1403] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:19:14 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:19:15.998977 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-fda581bf-1685-4c56-b5ca-ae055361fbb9 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:15.999628 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-fda581bf-1685-4c56-b5ca-ae055361fbb9 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:19:16.005585 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fda581bf-1685-4c56-b5ca-ae055361fbb9 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:16.006027 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fda581bf-1685-4c56-b5ca-ae055361fbb9 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:16.006886 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fda581bf-1685-4c56-b5ca-ae055361fbb9 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:16.007322 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-fda581bf-1685-4c56-b5ca-ae055361fbb9 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:16.127321 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-fda581bf-1685-4c56-b5ca-ae055361fbb9 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afa61134d0457aa9f886c4bece5df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2001cfaa564496ba271b544cfdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:19:16.135100 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-fda581bf-1685-4c56-b5ca-ae055361fbb9 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 200 len: 1754 microversion: 2.1 time: 0.139817 Sep 02 17:19:16.135659 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 733/1404] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:19:15 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 1754 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:19:17.153348 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-75cd57ca-1601-4082-8787-893887e92905 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:17.153348 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-75cd57ca-1601-4082-8787-893887e92905 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:19:17.159125 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-75cd57ca-1601-4082-8787-893887e92905 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:17.159578 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-75cd57ca-1601-4082-8787-893887e92905 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:17.160351 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-75cd57ca-1601-4082-8787-893887e92905 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:17.160783 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-75cd57ca-1601-4082-8787-893887e92905 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:17.285521 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-75cd57ca-1601-4082-8787-893887e92905 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afa61134d0457aa9f886c4bece5df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2001cfaa564496ba271b544cfdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:19:17.293183 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-75cd57ca-1601-4082-8787-893887e92905 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 200 len: 1754 microversion: 2.1 time: 0.144592 Sep 02 17:19:17.293746 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 672/1405] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:19:17 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 1754 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:19:17.546714 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-80bfa51d-c25b-45d5-98b9-3d7bf033fd5e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:17.547225 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-80bfa51d-c25b-45d5-98b9-3d7bf033fd5e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:19:17.553436 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-80bfa51d-c25b-45d5-98b9-3d7bf033fd5e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:17.553888 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-80bfa51d-c25b-45d5-98b9-3d7bf033fd5e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:17.554679 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-80bfa51d-c25b-45d5-98b9-3d7bf033fd5e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:17.555119 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-80bfa51d-c25b-45d5-98b9-3d7bf033fd5e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:17.568356 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.wsgi [None req-80bfa51d-c25b-45d5-98b9-3d7bf033fd5e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] HTTP exception thrown: Instance ea9c64d9-b562-4bb6-88a2-88434835b7c8 could not be found. Sep 02 17:19:17.568936 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-80bfa51d-c25b-45d5-98b9-3d7bf033fd5e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Returning 404 to user: Instance ea9c64d9-b562-4bb6-88a2-88434835b7c8 could not be found. {{(pid=108418) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:19:17.569741 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-80bfa51d-c25b-45d5-98b9-3d7bf033fd5e tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "DELETE /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8" status: 404 len: 111 microversion: 2.1 time: 0.026724 Sep 02 17:19:17.570243 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 734/1406] 10.222.0.41 () {58 vars in 1239 bytes} [Thu Sep 2 17:19:17 2021] DELETE /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 17:19:17.577780 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-85996386-dc9c-4b38-8654-190aa735962b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:17.578389 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-85996386-dc9c-4b38-8654-190aa735962b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: ea9c64d9-b562-4bb6-88a2-88434835b7c8] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:19:17.584046 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-85996386-dc9c-4b38-8654-190aa735962b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:17.584491 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-85996386-dc9c-4b38-8654-190aa735962b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:17.585253 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-85996386-dc9c-4b38-8654-190aa735962b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:17.585686 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-85996386-dc9c-4b38-8654-190aa735962b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:17.598464 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.wsgi [None req-85996386-dc9c-4b38-8654-190aa735962b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] HTTP exception thrown: Instance ea9c64d9-b562-4bb6-88a2-88434835b7c8 could not be found. Sep 02 17:19:17.599074 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-85996386-dc9c-4b38-8654-190aa735962b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Returning 404 to user: Instance ea9c64d9-b562-4bb6-88a2-88434835b7c8 could not be found. {{(pid=108417) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:19:17.600134 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-85996386-dc9c-4b38-8654-190aa735962b tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8" status: 404 len: 111 microversion: 2.1 time: 0.025763 Sep 02 17:19:17.600644 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 673/1407] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:19:17 2021] GET /compute/v2.1/servers/ea9c64d9-b562-4bb6-88a2-88434835b7c8 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 17:19:18.311328 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-43cefe13-73c1-4b06-b015-25d0b957b652 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:18.311885 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-43cefe13-73c1-4b06-b015-25d0b957b652 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:19:18.318374 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-43cefe13-73c1-4b06-b015-25d0b957b652 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:18.318848 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-43cefe13-73c1-4b06-b015-25d0b957b652 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:18.319608 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-43cefe13-73c1-4b06-b015-25d0b957b652 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:18.320046 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-43cefe13-73c1-4b06-b015-25d0b957b652 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:18.438547 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-43cefe13-73c1-4b06-b015-25d0b957b652 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afa61134d0457aa9f886c4bece5df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2001cfaa564496ba271b544cfdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:19:18.446276 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-43cefe13-73c1-4b06-b015-25d0b957b652 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 200 len: 1754 microversion: 2.1 time: 0.138711 Sep 02 17:19:18.446883 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 735/1408] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:19:18 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 1754 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:19:18.727180 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-0f86ecac-5d6a-452d-a68c-aa53b9592ff3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:18.727709 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-0f86ecac-5d6a-452d-a68c-aa53b9592ff3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:19:18.733554 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0f86ecac-5d6a-452d-a68c-aa53b9592ff3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:18.734004 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0f86ecac-5d6a-452d-a68c-aa53b9592ff3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:18.734806 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0f86ecac-5d6a-452d-a68c-aa53b9592ff3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:18.735244 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0f86ecac-5d6a-452d-a68c-aa53b9592ff3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:18.749111 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.wsgi [None req-0f86ecac-5d6a-452d-a68c-aa53b9592ff3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] HTTP exception thrown: Instance 77697955-515d-4f49-8b5e-8d01b670ff58 could not be found. Sep 02 17:19:18.749701 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-0f86ecac-5d6a-452d-a68c-aa53b9592ff3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Returning 404 to user: Instance 77697955-515d-4f49-8b5e-8d01b670ff58 could not be found. {{(pid=108417) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:19:18.750526 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-0f86ecac-5d6a-452d-a68c-aa53b9592ff3 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "DELETE /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 404 len: 111 microversion: 2.1 time: 0.027656 Sep 02 17:19:18.751529 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 674/1409] 10.222.0.41 () {58 vars in 1239 bytes} [Thu Sep 2 17:19:18 2021] DELETE /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 17:19:18.758948 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-e5b62b28-2d15-4931-805e-38a59fcfa632 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:18.759700 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-e5b62b28-2d15-4931-805e-38a59fcfa632 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] [instance: 77697955-515d-4f49-8b5e-8d01b670ff58] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:19:18.765720 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e5b62b28-2d15-4931-805e-38a59fcfa632 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:18.766168 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e5b62b28-2d15-4931-805e-38a59fcfa632 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:18.767011 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e5b62b28-2d15-4931-805e-38a59fcfa632 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:18.767466 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-e5b62b28-2d15-4931-805e-38a59fcfa632 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:18.781560 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.wsgi [None req-e5b62b28-2d15-4931-805e-38a59fcfa632 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] HTTP exception thrown: Instance 77697955-515d-4f49-8b5e-8d01b670ff58 could not be found. Sep 02 17:19:18.782159 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-e5b62b28-2d15-4931-805e-38a59fcfa632 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] Returning 404 to user: Instance 77697955-515d-4f49-8b5e-8d01b670ff58 could not be found. {{(pid=108418) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:19:18.783036 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-e5b62b28-2d15-4931-805e-38a59fcfa632 tempest-AttachVolumeTestJSON-353953480 tempest-AttachVolumeTestJSON-353953480-project] 10.222.0.41 "GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58" status: 404 len: 111 microversion: 2.1 time: 0.027783 Sep 02 17:19:18.783599 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 736/1410] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:19:18 2021] GET /compute/v2.1/servers/77697955-515d-4f49-8b5e-8d01b670ff58 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 17:19:19.463130 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-d721079d-7822-4099-adb4-d69f5322671a tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:19.463986 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-d721079d-7822-4099-adb4-d69f5322671a tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:19:19.469800 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d721079d-7822-4099-adb4-d69f5322671a tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:19.470443 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d721079d-7822-4099-adb4-d69f5322671a tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:19.471408 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d721079d-7822-4099-adb4-d69f5322671a tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:19.471994 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-d721079d-7822-4099-adb4-d69f5322671a tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:19.565508 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-7ab48cc4-18ee-4abb-a91a-0e4ea47ec94e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:19.566223 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-7ab48cc4-18ee-4abb-a91a-0e4ea47ec94e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 5f2982c3-a18d-44c5-96be-3752f9d9a195] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:19:19.573409 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7ab48cc4-18ee-4abb-a91a-0e4ea47ec94e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:19.573859 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7ab48cc4-18ee-4abb-a91a-0e4ea47ec94e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:19.574860 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7ab48cc4-18ee-4abb-a91a-0e4ea47ec94e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:19.575296 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7ab48cc4-18ee-4abb-a91a-0e4ea47ec94e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:19.599969 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-7ab48cc4-18ee-4abb-a91a-0e4ea47ec94e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 5f2982c3-a18d-44c5-96be-3752f9d9a195] Going to try to terminate instance {{(pid=108418) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 17:19:19.685304 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-7ab48cc4-18ee-4abb-a91a-0e4ea47ec94e tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "DELETE /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195" status: 204 len: 0 microversion: 2.1 time: 0.120414 Sep 02 17:19:19.686050 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 737/1411] 10.222.0.41 () {58 vars in 1239 bytes} [Thu Sep 2 17:19:19 2021] DELETE /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 17:19:19.691784 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-16f69fee-b043-4258-967d-904d78385abd req-24503e6a-a979-4149-be19-3f3fd6a96a6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f2982c3-a18d-44c5-96be-3752f9d9a195", "tag": "702539df-f620-4be7-9e22-1b97e1bb4dbe"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:19:19.693242 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:19:19.693242 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:19:19.700686 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-16f69fee-b043-4258-967d-904d78385abd req-24503e6a-a979-4149-be19-3f3fd6a96a6f service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:19.701374 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-16f69fee-b043-4258-967d-904d78385abd req-24503e6a-a979-4149-be19-3f3fd6a96a6f service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:19.712711 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-16f69fee-b043-4258-967d-904d78385abd req-24503e6a-a979-4149-be19-3f3fd6a96a6f service nova] Creating event network-changed:702539df-f620-4be7-9e22-1b97e1bb4dbe for instance 5f2982c3-a18d-44c5-96be-3752f9d9a195 on hv-cinder-80626 Sep 02 17:19:19.717933 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-16f69fee-b043-4258-967d-904d78385abd req-24503e6a-a979-4149-be19-3f3fd6a96a6f service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030336 Sep 02 17:19:19.718548 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 738/1412] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:19:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:19:19.723755 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-2bb6eaee-f73b-4d64-8444-61bd259e6ff8 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:19.724123 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-2bb6eaee-f73b-4d64-8444-61bd259e6ff8 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 5f2982c3-a18d-44c5-96be-3752f9d9a195] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:19:19.728826 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-d721079d-7822-4099-adb4-d69f5322671a tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afa61134d0457aa9f886c4bece5df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2001cfaa564496ba271b544cfdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:19:19.730016 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2bb6eaee-f73b-4d64-8444-61bd259e6ff8 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:19.730474 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2bb6eaee-f73b-4d64-8444-61bd259e6ff8 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:19.731279 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2bb6eaee-f73b-4d64-8444-61bd259e6ff8 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:19.731710 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-2bb6eaee-f73b-4d64-8444-61bd259e6ff8 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:19.740698 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-d721079d-7822-4099-adb4-d69f5322671a tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 200 len: 1754 microversion: 2.1 time: 0.281046 Sep 02 17:19:19.742270 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 675/1413] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:19:19 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 1754 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:19:19.951770 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-2bb6eaee-f73b-4d64-8444-61bd259e6ff8 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:19:19.959327 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-2bb6eaee-f73b-4d64-8444-61bd259e6ff8 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195" status: 200 len: 1575 microversion: 2.1 time: 0.239668 Sep 02 17:19:19.969648 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 739/1414] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:19:19 2021] GET /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195 => generated 1575 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:19:20.759229 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-b98f23e3-ae9d-4695-ae45-b593419e6603 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:20.759853 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-b98f23e3-ae9d-4695-ae45-b593419e6603 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:19:20.765905 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b98f23e3-ae9d-4695-ae45-b593419e6603 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:20.766467 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b98f23e3-ae9d-4695-ae45-b593419e6603 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:20.767382 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b98f23e3-ae9d-4695-ae45-b593419e6603 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:20.767906 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-b98f23e3-ae9d-4695-ae45-b593419e6603 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:20.977479 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-6f9b687f-7587-4075-837f-418be701fde2 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:20.978168 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-6f9b687f-7587-4075-837f-418be701fde2 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 5f2982c3-a18d-44c5-96be-3752f9d9a195] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:19:20.984826 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6f9b687f-7587-4075-837f-418be701fde2 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:20.985353 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6f9b687f-7587-4075-837f-418be701fde2 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:20.986181 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6f9b687f-7587-4075-837f-418be701fde2 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:20.987083 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6f9b687f-7587-4075-837f-418be701fde2 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:20.992200 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-b98f23e3-ae9d-4695-ae45-b593419e6603 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afa61134d0457aa9f886c4bece5df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2001cfaa564496ba271b544cfdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:19:21.005716 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-b98f23e3-ae9d-4695-ae45-b593419e6603 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 200 len: 1754 microversion: 2.1 time: 0.249933 Sep 02 17:19:21.017458 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 676/1415] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:19:20 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 1754 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:19:21.122707 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-6f9b687f-7587-4075-837f-418be701fde2 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:19:21.133287 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-6f9b687f-7587-4075-837f-418be701fde2 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195" status: 200 len: 1457 microversion: 2.1 time: 0.160351 Sep 02 17:19:21.134102 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 740/1416] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:19:20 2021] GET /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195 => generated 1457 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 02 17:19:22.023938 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-224afb94-5b80-4896-a079-60677a271a79 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:22.025155 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-224afb94-5b80-4896-a079-60677a271a79 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:19:22.037152 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-224afb94-5b80-4896-a079-60677a271a79 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:22.037724 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-224afb94-5b80-4896-a079-60677a271a79 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:22.038990 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-224afb94-5b80-4896-a079-60677a271a79 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:22.039762 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-224afb94-5b80-4896-a079-60677a271a79 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:22.151241 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-c16b9f0a-f1c3-43ea-9dca-94003f54abfb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:22.151858 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-c16b9f0a-f1c3-43ea-9dca-94003f54abfb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 5f2982c3-a18d-44c5-96be-3752f9d9a195] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:19:22.161105 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c16b9f0a-f1c3-43ea-9dca-94003f54abfb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:22.161836 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c16b9f0a-f1c3-43ea-9dca-94003f54abfb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:22.162831 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c16b9f0a-f1c3-43ea-9dca-94003f54abfb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:22.166330 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-c16b9f0a-f1c3-43ea-9dca-94003f54abfb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:22.278697 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-224afb94-5b80-4896-a079-60677a271a79 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afa61134d0457aa9f886c4bece5df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2001cfaa564496ba271b544cfdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:19:22.293999 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-c16b9f0a-f1c3-43ea-9dca-94003f54abfb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:19:22.299983 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-224afb94-5b80-4896-a079-60677a271a79 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 200 len: 1757 microversion: 2.1 time: 0.280399 Sep 02 17:19:22.302500 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 677/1417] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:19:22 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 1757 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:19:22.319995 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-c16b9f0a-f1c3-43ea-9dca-94003f54abfb tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195" status: 200 len: 1389 microversion: 2.1 time: 0.154331 Sep 02 17:19:22.320638 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 741/1418] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:19:22 2021] GET /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195 => generated 1389 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:19:22.351559 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [req-58d6c0a8-3a21-4a75-8534-c827d0094df3 req-fd3b2c2a-7692-4342-9039-9c6e4fab1599 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f2982c3-a18d-44c5-96be-3752f9d9a195", "name": "network-vif-deleted", "tag": "702539df-f620-4be7-9e22-1b97e1bb4dbe"}]} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:19:22.353081 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:19:22.353081 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: warnings.warn(msg) Sep 02 17:19:22.361847 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-58d6c0a8-3a21-4a75-8534-c827d0094df3 req-fd3b2c2a-7692-4342-9039-9c6e4fab1599 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:22.362980 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-58d6c0a8-3a21-4a75-8534-c827d0094df3 req-fd3b2c2a-7692-4342-9039-9c6e4fab1599 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:22.382733 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.compute.server_external_events [req-58d6c0a8-3a21-4a75-8534-c827d0094df3 req-fd3b2c2a-7692-4342-9039-9c6e4fab1599 service nova] Creating event network-vif-deleted:702539df-f620-4be7-9e22-1b97e1bb4dbe for instance 5f2982c3-a18d-44c5-96be-3752f9d9a195 on hv-cinder-80626 Sep 02 17:19:22.392405 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [req-58d6c0a8-3a21-4a75-8534-c827d0094df3 req-fd3b2c2a-7692-4342-9039-9c6e4fab1599 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044921 Sep 02 17:19:22.393592 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 678/1419] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:19:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:19:23.343214 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-6a574567-4c1c-4944-8089-8f60d41e41c4 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:23.343808 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-6a574567-4c1c-4944-8089-8f60d41e41c4 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 5f2982c3-a18d-44c5-96be-3752f9d9a195] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:19:23.349728 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6a574567-4c1c-4944-8089-8f60d41e41c4 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:23.350183 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6a574567-4c1c-4944-8089-8f60d41e41c4 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:23.350977 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6a574567-4c1c-4944-8089-8f60d41e41c4 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:23.351415 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6a574567-4c1c-4944-8089-8f60d41e41c4 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:23.370991 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.wsgi [None req-6a574567-4c1c-4944-8089-8f60d41e41c4 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] HTTP exception thrown: Instance 5f2982c3-a18d-44c5-96be-3752f9d9a195 could not be found. Sep 02 17:19:23.370991 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-6a574567-4c1c-4944-8089-8f60d41e41c4 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Returning 404 to user: Instance 5f2982c3-a18d-44c5-96be-3752f9d9a195 could not be found. {{(pid=108418) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:19:23.370991 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-6a574567-4c1c-4944-8089-8f60d41e41c4 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195" status: 404 len: 111 microversion: 2.1 time: 0.027745 Sep 02 17:19:23.370991 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 742/1420] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:19:23 2021] GET /compute/v2.1/servers/5f2982c3-a18d-44c5-96be-3752f9d9a195 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 17:19:26.444128 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-2535833d-5d41-4f02-8a77-ee30b9069514 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:26.444729 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-2535833d-5d41-4f02-8a77-ee30b9069514 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 3bd37709-df01-425f-bfd6-a30193970df2] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:19:26.447570 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-c83e030b-faa2-4c3e-a178-bbe328873c51 req-3f37ffd6-ba20-431d-978e-a78c0df31085 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bd37709-df01-425f-bfd6-a30193970df2", "tag": "9ca48daf-e148-4df6-9dd9-8d23ea21195e"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:19:26.449737 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:19:26.449737 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:19:26.453207 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2535833d-5d41-4f02-8a77-ee30b9069514 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:26.453671 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2535833d-5d41-4f02-8a77-ee30b9069514 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:26.454456 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2535833d-5d41-4f02-8a77-ee30b9069514 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:26.454935 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-2535833d-5d41-4f02-8a77-ee30b9069514 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:26.458771 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-c83e030b-faa2-4c3e-a178-bbe328873c51 req-3f37ffd6-ba20-431d-978e-a78c0df31085 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:26.459608 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-c83e030b-faa2-4c3e-a178-bbe328873c51 req-3f37ffd6-ba20-431d-978e-a78c0df31085 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:26.471694 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-c83e030b-faa2-4c3e-a178-bbe328873c51 req-3f37ffd6-ba20-431d-978e-a78c0df31085 service nova] Creating event network-changed:9ca48daf-e148-4df6-9dd9-8d23ea21195e for instance 3bd37709-df01-425f-bfd6-a30193970df2 on hv-cinder-80626 Sep 02 17:19:26.477843 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-c83e030b-faa2-4c3e-a178-bbe328873c51 req-3f37ffd6-ba20-431d-978e-a78c0df31085 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034725 Sep 02 17:19:26.478908 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 743/1421] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:19:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:19:26.487500 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-2535833d-5d41-4f02-8a77-ee30b9069514 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 3bd37709-df01-425f-bfd6-a30193970df2] Going to try to terminate instance {{(pid=108417) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 17:19:26.588791 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-2535833d-5d41-4f02-8a77-ee30b9069514 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "DELETE /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2" status: 204 len: 0 microversion: 2.1 time: 0.148098 Sep 02 17:19:26.590329 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 679/1422] 10.222.0.41 () {58 vars in 1239 bytes} [Thu Sep 2 17:19:26 2021] DELETE /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 17:19:26.599444 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-76675812-304f-43e8-ba6c-bbe20f27f3c8 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:26.600054 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-76675812-304f-43e8-ba6c-bbe20f27f3c8 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 3bd37709-df01-425f-bfd6-a30193970df2] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:19:26.606076 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-76675812-304f-43e8-ba6c-bbe20f27f3c8 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:26.606521 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-76675812-304f-43e8-ba6c-bbe20f27f3c8 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:26.607547 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-76675812-304f-43e8-ba6c-bbe20f27f3c8 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:26.608194 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-76675812-304f-43e8-ba6c-bbe20f27f3c8 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:26.846510 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-76675812-304f-43e8-ba6c-bbe20f27f3c8 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:19:26.853966 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-76675812-304f-43e8-ba6c-bbe20f27f3c8 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2" status: 200 len: 1576 microversion: 2.1 time: 0.259062 Sep 02 17:19:26.854492 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 744/1423] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:19:26 2021] GET /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2 => generated 1576 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:19:27.871719 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-0810c452-977b-480d-84c0-dcd5e9c747c1 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:27.872412 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-0810c452-977b-480d-84c0-dcd5e9c747c1 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 3bd37709-df01-425f-bfd6-a30193970df2] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:19:27.878070 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0810c452-977b-480d-84c0-dcd5e9c747c1 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:27.878507 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0810c452-977b-480d-84c0-dcd5e9c747c1 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:27.879289 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0810c452-977b-480d-84c0-dcd5e9c747c1 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:27.879716 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-0810c452-977b-480d-84c0-dcd5e9c747c1 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:27.997040 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-0810c452-977b-480d-84c0-dcd5e9c747c1 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:19:28.004739 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-0810c452-977b-480d-84c0-dcd5e9c747c1 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2" status: 200 len: 1458 microversion: 2.1 time: 0.137170 Sep 02 17:19:28.005310 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 680/1424] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:19:27 2021] GET /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2 => generated 1458 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:19:28.951530 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-6ff19622-9454-4081-bc41-feef09cda09d req-fbe98d96-d029-4de0-acf9-a1d9c70772b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bd37709-df01-425f-bfd6-a30193970df2", "name": "network-vif-deleted", "tag": "9ca48daf-e148-4df6-9dd9-8d23ea21195e"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:19:28.953258 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:19:28.953258 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:19:28.961123 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-6ff19622-9454-4081-bc41-feef09cda09d req-fbe98d96-d029-4de0-acf9-a1d9c70772b6 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:28.961814 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-6ff19622-9454-4081-bc41-feef09cda09d req-fbe98d96-d029-4de0-acf9-a1d9c70772b6 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:28.973337 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-6ff19622-9454-4081-bc41-feef09cda09d req-fbe98d96-d029-4de0-acf9-a1d9c70772b6 service nova] Creating event network-vif-deleted:9ca48daf-e148-4df6-9dd9-8d23ea21195e for instance 3bd37709-df01-425f-bfd6-a30193970df2 on hv-cinder-80626 Sep 02 17:19:28.978816 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-6ff19622-9454-4081-bc41-feef09cda09d req-fbe98d96-d029-4de0-acf9-a1d9c70772b6 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031943 Sep 02 17:19:28.979844 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 745/1425] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:19:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:19:29.021958 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-5430d179-2be9-4f7d-91a7-148ebed14485 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:29.022687 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-5430d179-2be9-4f7d-91a7-148ebed14485 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 3bd37709-df01-425f-bfd6-a30193970df2] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:19:29.028679 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5430d179-2be9-4f7d-91a7-148ebed14485 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:29.029377 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5430d179-2be9-4f7d-91a7-148ebed14485 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:29.030153 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5430d179-2be9-4f7d-91a7-148ebed14485 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:29.030592 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-5430d179-2be9-4f7d-91a7-148ebed14485 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:29.095538 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-5430d179-2be9-4f7d-91a7-148ebed14485 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6df6e202f8b64bb0b33226402b65adaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc090408372e41379709e2067823b1a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:19:29.102961 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-5430d179-2be9-4f7d-91a7-148ebed14485 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2" status: 200 len: 1226 microversion: 2.1 time: 0.085558 Sep 02 17:19:29.103808 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 681/1426] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:19:29 2021] GET /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:19:30.120718 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-1987c1b8-369a-47aa-9d2e-77657212aaef tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:30.121421 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-1987c1b8-369a-47aa-9d2e-77657212aaef tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 3bd37709-df01-425f-bfd6-a30193970df2] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:19:30.127528 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1987c1b8-369a-47aa-9d2e-77657212aaef tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:30.127982 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1987c1b8-369a-47aa-9d2e-77657212aaef tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:30.128785 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1987c1b8-369a-47aa-9d2e-77657212aaef tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:30.129219 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-1987c1b8-369a-47aa-9d2e-77657212aaef tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:30.141818 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.wsgi [None req-1987c1b8-369a-47aa-9d2e-77657212aaef tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] HTTP exception thrown: Instance 3bd37709-df01-425f-bfd6-a30193970df2 could not be found. Sep 02 17:19:30.142391 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-1987c1b8-369a-47aa-9d2e-77657212aaef tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Returning 404 to user: Instance 3bd37709-df01-425f-bfd6-a30193970df2 could not be found. {{(pid=108418) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:19:30.143228 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-1987c1b8-369a-47aa-9d2e-77657212aaef tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2" status: 404 len: 111 microversion: 2.1 time: 0.026870 Sep 02 17:19:30.143735 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 746/1427] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:19:30 2021] GET /compute/v2.1/servers/3bd37709-df01-425f-bfd6-a30193970df2 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 17:19:30.593429 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-cb11be0b-a0b5-44b3-a1c4-88a5ae20f2d5 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:30.593941 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-cb11be0b-a0b5-44b3-a1c4-88a5ae20f2d5 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:19:30.599619 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-cb11be0b-a0b5-44b3-a1c4-88a5ae20f2d5 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:30.600075 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-cb11be0b-a0b5-44b3-a1c4-88a5ae20f2d5 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:30.600839 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-cb11be0b-a0b5-44b3-a1c4-88a5ae20f2d5 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:30.601343 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-cb11be0b-a0b5-44b3-a1c4-88a5ae20f2d5 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:30.614364 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.wsgi [None req-cb11be0b-a0b5-44b3-a1c4-88a5ae20f2d5 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] HTTP exception thrown: Instance 34e36f29-2bc8-4586-8de2-3a218984c046 could not be found. Sep 02 17:19:30.614976 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-cb11be0b-a0b5-44b3-a1c4-88a5ae20f2d5 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Returning 404 to user: Instance 34e36f29-2bc8-4586-8de2-3a218984c046 could not be found. {{(pid=108417) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:19:30.615789 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-cb11be0b-a0b5-44b3-a1c4-88a5ae20f2d5 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "DELETE /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 404 len: 111 microversion: 2.1 time: 0.026255 Sep 02 17:19:30.616315 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 682/1428] 10.222.0.41 () {58 vars in 1239 bytes} [Thu Sep 2 17:19:30 2021] DELETE /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 17:19:30.625395 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-8e2f5645-ff5f-4ca9-a649-6754372326b3 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:30.625942 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-8e2f5645-ff5f-4ca9-a649-6754372326b3 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] [instance: 34e36f29-2bc8-4586-8de2-3a218984c046] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:19:30.632653 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8e2f5645-ff5f-4ca9-a649-6754372326b3 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:30.633178 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8e2f5645-ff5f-4ca9-a649-6754372326b3 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:30.634112 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8e2f5645-ff5f-4ca9-a649-6754372326b3 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:19:30.634728 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8e2f5645-ff5f-4ca9-a649-6754372326b3 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:19:30.651961 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.wsgi [None req-8e2f5645-ff5f-4ca9-a649-6754372326b3 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] HTTP exception thrown: Instance 34e36f29-2bc8-4586-8de2-3a218984c046 could not be found. Sep 02 17:19:30.652613 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-8e2f5645-ff5f-4ca9-a649-6754372326b3 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Returning 404 to user: Instance 34e36f29-2bc8-4586-8de2-3a218984c046 could not be found. {{(pid=108418) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:19:30.653434 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-8e2f5645-ff5f-4ca9-a649-6754372326b3 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046" status: 404 len: 111 microversion: 2.1 time: 0.032321 Sep 02 17:19:30.654081 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 747/1429] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:19:30 2021] GET /compute/v2.1/servers/34e36f29-2bc8-4586-8de2-3a218984c046 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 17:19:31.946512 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-a5869388-1c7d-40a8-8d1e-4769653c56a4 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] Calling method '.version_select at 0x7fca984034c0>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:19:31.964105 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-a5869388-1c7d-40a8-8d1e-4769653c56a4 tempest-TestVolumeBootPattern-1083145229 tempest-TestVolumeBootPattern-1083145229-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1934407481" status: 202 len: 0 microversion: 2.1 time: 0.021360 Sep 02 17:19:31.964663 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 683/1430] 10.222.0.41 () {58 vars in 1263 bytes} [Thu Sep 2 17:19:31 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1934407481 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:20:05.167486 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-d3b22ee5-6f84-4db2-b620-b8a5d2635096 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-163242033"}} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:20:05.168018 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-d3b22ee5-6f84-4db2-b620-b8a5d2635096 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:20:05.173998 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d3b22ee5-6f84-4db2-b620-b8a5d2635096 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:20:05.174439 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d3b22ee5-6f84-4db2-b620-b8a5d2635096 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:20:05.175232 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d3b22ee5-6f84-4db2-b620-b8a5d2635096 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:20:05.175666 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-d3b22ee5-6f84-4db2-b620-b8a5d2635096 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:20:05.295715 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.network.security_group_api [None req-d3b22ee5-6f84-4db2-b620-b8a5d2635096 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Removing security group 967935ff-cfd4-48e0-9395-c819e4ad235e from port 31f557d1-9615-485b-967b-0c514ea54c30 Sep 02 17:20:05.613400 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-d3b22ee5-6f84-4db2-b620-b8a5d2635096 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "POST /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1/action" status: 202 len: 0 microversion: 2.1 time: 0.449405 Sep 02 17:20:05.622044 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 748/1431] 10.222.0.41 () {60 vars in 1278 bytes} [Thu Sep 2 17:20:05 2021] POST /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1/action => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:20:05.630758 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [req-38ed42cd-a5ee-4734-827d-5705c99f260f req-c7b3e044-4496-4dd7-8b57-b671a5c25d30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "371ab7f3-5976-495e-90cb-d0e9035d8eb1", "tag": "31f557d1-9615-485b-967b-0c514ea54c30"}]} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:20:05.632230 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:20:05.632230 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: warnings.warn(msg) Sep 02 17:20:05.653118 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-38ed42cd-a5ee-4734-827d-5705c99f260f req-c7b3e044-4496-4dd7-8b57-b671a5c25d30 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:20:05.653939 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-38ed42cd-a5ee-4734-827d-5705c99f260f req-c7b3e044-4496-4dd7-8b57-b671a5c25d30 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:20:05.670206 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.compute.server_external_events [req-38ed42cd-a5ee-4734-827d-5705c99f260f req-c7b3e044-4496-4dd7-8b57-b671a5c25d30 service nova] Creating event network-changed:31f557d1-9615-485b-967b-0c514ea54c30 for instance 371ab7f3-5976-495e-90cb-d0e9035d8eb1 on hv-cinder-80626 Sep 02 17:20:05.679008 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [req-38ed42cd-a5ee-4734-827d-5705c99f260f req-c7b3e044-4496-4dd7-8b57-b671a5c25d30 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055620 Sep 02 17:20:05.680048 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 684/1432] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:20:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:20:06.708286 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-6f8e9128-489a-4c60-a1be-703b58d558e5 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:20:06.709160 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-6f8e9128-489a-4c60-a1be-703b58d558e5 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:20:06.717160 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6f8e9128-489a-4c60-a1be-703b58d558e5 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:20:06.717612 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6f8e9128-489a-4c60-a1be-703b58d558e5 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:20:06.718391 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6f8e9128-489a-4c60-a1be-703b58d558e5 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:20:06.718859 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-6f8e9128-489a-4c60-a1be-703b58d558e5 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:20:06.804373 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.objects.instance [None req-6f8e9128-489a-4c60-a1be-703b58d558e5 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lazy-loading 'services' on Instance uuid 371ab7f3-5976-495e-90cb-d0e9035d8eb1 {{(pid=108418) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Sep 02 17:20:06.839709 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [req-195307b5-f6de-4410-89f4-8cebc9b276f1 req-42e0293a-16f9-438c-9a20-3413e39fe13e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "371ab7f3-5976-495e-90cb-d0e9035d8eb1", "tag": "31f557d1-9615-485b-967b-0c514ea54c30"}]} {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:20:06.841256 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:20:06.841256 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: warnings.warn(msg) Sep 02 17:20:06.848522 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-195307b5-f6de-4410-89f4-8cebc9b276f1 req-42e0293a-16f9-438c-9a20-3413e39fe13e service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:20:06.849213 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [req-195307b5-f6de-4410-89f4-8cebc9b276f1 req-42e0293a-16f9-438c-9a20-3413e39fe13e service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:20:06.861351 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.compute.server_external_events [req-195307b5-f6de-4410-89f4-8cebc9b276f1 req-42e0293a-16f9-438c-9a20-3413e39fe13e service nova] Creating event network-changed:31f557d1-9615-485b-967b-0c514ea54c30 for instance 371ab7f3-5976-495e-90cb-d0e9035d8eb1 on hv-cinder-80626 Sep 02 17:20:06.867011 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [req-195307b5-f6de-4410-89f4-8cebc9b276f1 req-42e0293a-16f9-438c-9a20-3413e39fe13e service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161350 Sep 02 17:20:06.867674 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 685/1433] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:20:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:20:06.876178 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-6f8e9128-489a-4c60-a1be-703b58d558e5 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "DELETE /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1/os-volume_attachments/27a4f6dc-41f1-4c50-9e5d-b96f41d0988a" status: 202 len: 0 microversion: 2.1 time: 0.173114 Sep 02 17:20:06.876753 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 749/1434] 10.222.0.41 () {58 vars in 1416 bytes} [Thu Sep 2 17:20:06 2021] DELETE /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1/os-volume_attachments/27a4f6dc-41f1-4c50-9e5d-b96f41d0988a => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 02 17:20:06.885855 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-e8d11c09-57d8-4559-a771-e67bb2c8c8be tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:20:06.886869 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-e8d11c09-57d8-4559-a771-e67bb2c8c8be tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:20:06.892739 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e8d11c09-57d8-4559-a771-e67bb2c8c8be tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:20:06.893186 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e8d11c09-57d8-4559-a771-e67bb2c8c8be tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:20:06.893949 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e8d11c09-57d8-4559-a771-e67bb2c8c8be tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:20:06.894379 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-e8d11c09-57d8-4559-a771-e67bb2c8c8be tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:20:06.922094 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-e8d11c09-57d8-4559-a771-e67bb2c8c8be tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040231 Sep 02 17:20:06.922661 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 686/1435] 10.222.0.41 () {58 vars in 1302 bytes} [Thu Sep 2 17:20:06 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:20:07.934165 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-8cb48039-8587-453f-b356-25bd8e7e0585 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:20:07.935170 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-8cb48039-8587-453f-b356-25bd8e7e0585 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:20:07.942178 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8cb48039-8587-453f-b356-25bd8e7e0585 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:20:07.943107 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8cb48039-8587-453f-b356-25bd8e7e0585 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:20:07.944196 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8cb48039-8587-453f-b356-25bd8e7e0585 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:20:07.944743 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-8cb48039-8587-453f-b356-25bd8e7e0585 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:20:07.974280 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-8cb48039-8587-453f-b356-25bd8e7e0585 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044330 Sep 02 17:20:07.974854 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 750/1436] 10.222.0.41 () {58 vars in 1302 bytes} [Thu Sep 2 17:20:07 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:20:08.985668 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-a701e671-9f34-4d8a-975b-5609c32cf38e tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:20:08.986575 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-a701e671-9f34-4d8a-975b-5609c32cf38e tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:20:08.992435 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a701e671-9f34-4d8a-975b-5609c32cf38e tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:20:08.992883 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a701e671-9f34-4d8a-975b-5609c32cf38e tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:20:08.993912 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a701e671-9f34-4d8a-975b-5609c32cf38e tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:20:08.994349 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-a701e671-9f34-4d8a-975b-5609c32cf38e tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:20:09.022897 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-a701e671-9f34-4d8a-975b-5609c32cf38e tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040993 Sep 02 17:20:09.023449 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 687/1437] 10.222.0.41 () {58 vars in 1302 bytes} [Thu Sep 2 17:20:08 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 02 17:20:10.035003 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-43305e21-9d84-4cb9-8ad2-c7237d57dde5 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:20:10.035901 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-43305e21-9d84-4cb9-8ad2-c7237d57dde5 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:20:10.042145 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-43305e21-9d84-4cb9-8ad2-c7237d57dde5 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:20:10.042590 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-43305e21-9d84-4cb9-8ad2-c7237d57dde5 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:20:10.043372 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-43305e21-9d84-4cb9-8ad2-c7237d57dde5 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:20:10.043800 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-43305e21-9d84-4cb9-8ad2-c7237d57dde5 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:20:10.071200 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-43305e21-9d84-4cb9-8ad2-c7237d57dde5 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.039965 Sep 02 17:20:10.071735 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 751/1438] 10.222.0.41 () {58 vars in 1302 bytes} [Thu Sep 2 17:20:10 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1/os-volume_attachments => generated 25 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 02 17:20:10.081296 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-df3fbefa-f75c-46bc-96e9-6c4ee3cc129b tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:20:10.081791 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-df3fbefa-f75c-46bc-96e9-6c4ee3cc129b tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:20:10.087638 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-df3fbefa-f75c-46bc-96e9-6c4ee3cc129b tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:20:10.088084 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-df3fbefa-f75c-46bc-96e9-6c4ee3cc129b tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:20:10.088841 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-df3fbefa-f75c-46bc-96e9-6c4ee3cc129b tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:20:10.089301 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-df3fbefa-f75c-46bc-96e9-6c4ee3cc129b tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:20:10.166926 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.wsgi [None req-df3fbefa-f75c-46bc-96e9-6c4ee3cc129b tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] HTTP exception thrown: Instance 371ab7f3-5976-495e-90cb-d0e9035d8eb1 is not attached to volume 27a4f6dc-41f1-4c50-9e5d-b96f41d0988a Sep 02 17:20:10.167559 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-df3fbefa-f75c-46bc-96e9-6c4ee3cc129b tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Returning 404 to user: Instance 371ab7f3-5976-495e-90cb-d0e9035d8eb1 is not attached to volume 27a4f6dc-41f1-4c50-9e5d-b96f41d0988a {{(pid=108417) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:20:10.168401 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-df3fbefa-f75c-46bc-96e9-6c4ee3cc129b tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "DELETE /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1/os-volume_attachments/27a4f6dc-41f1-4c50-9e5d-b96f41d0988a" status: 404 len: 154 microversion: 2.1 time: 0.090924 Sep 02 17:20:10.168939 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 688/1439] 10.222.0.41 () {58 vars in 1416 bytes} [Thu Sep 2 17:20:10 2021] DELETE /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1/os-volume_attachments/27a4f6dc-41f1-4c50-9e5d-b96f41d0988a => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 17:20:11.313193 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-7e4101ee-33f7-47c3-85e9-a47475df37d6 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:20:11.313621 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-7e4101ee-33f7-47c3-85e9-a47475df37d6 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:20:11.320319 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7e4101ee-33f7-47c3-85e9-a47475df37d6 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:20:11.320769 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7e4101ee-33f7-47c3-85e9-a47475df37d6 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:20:11.321574 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7e4101ee-33f7-47c3-85e9-a47475df37d6 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:20:11.322018 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7e4101ee-33f7-47c3-85e9-a47475df37d6 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:20:11.345860 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-7e4101ee-33f7-47c3-85e9-a47475df37d6 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Going to try to terminate instance {{(pid=108418) delete /opt/stack/nova/nova/compute/api.py:2611}} Sep 02 17:20:11.421128 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-7e4101ee-33f7-47c3-85e9-a47475df37d6 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "DELETE /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 204 len: 0 microversion: 2.1 time: 0.111426 Sep 02 17:20:11.421707 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 752/1440] 10.222.0.41 () {58 vars in 1239 bytes} [Thu Sep 2 17:20:11 2021] DELETE /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 02 17:20:11.431709 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-dd9828e4-ed56-49b7-9846-cc52a1ab6cac tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:20:11.432398 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-dd9828e4-ed56-49b7-9846-cc52a1ab6cac tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:20:11.439439 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-dd9828e4-ed56-49b7-9846-cc52a1ab6cac tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:20:11.440213 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-dd9828e4-ed56-49b7-9846-cc52a1ab6cac tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:20:11.440971 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-dd9828e4-ed56-49b7-9846-cc52a1ab6cac tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:20:11.441396 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-dd9828e4-ed56-49b7-9846-cc52a1ab6cac tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:20:11.575610 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-dd9828e4-ed56-49b7-9846-cc52a1ab6cac tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afa61134d0457aa9f886c4bece5df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2001cfaa564496ba271b544cfdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:20:11.583458 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-dd9828e4-ed56-49b7-9846-cc52a1ab6cac tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 200 len: 1553 microversion: 2.1 time: 0.156613 Sep 02 17:20:11.584096 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 689/1441] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:20:11 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:20:12.601578 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-7fcf95be-e479-4942-9ed6-d1dd31d7e5ff tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:20:12.602276 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.compute.api [None req-7fcf95be-e479-4942-9ed6-d1dd31d7e5ff tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108418) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:20:12.612662 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7fcf95be-e479-4942-9ed6-d1dd31d7e5ff tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:20:12.613111 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7fcf95be-e479-4942-9ed6-d1dd31d7e5ff tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:20:12.613894 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7fcf95be-e479-4942-9ed6-d1dd31d7e5ff tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:20:12.614325 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [None req-7fcf95be-e479-4942-9ed6-d1dd31d7e5ff tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:20:12.734672 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.policy [None req-7fcf95be-e479-4942-9ed6-d1dd31d7e5ff tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afa61134d0457aa9f886c4bece5df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2001cfaa564496ba271b544cfdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108418) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:20:12.743044 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-7fcf95be-e479-4942-9ed6-d1dd31d7e5ff tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 200 len: 1553 microversion: 2.1 time: 0.146324 Sep 02 17:20:12.743860 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 753/1442] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:20:12 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 1553 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:20:13.759756 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-4a46327b-f273-4afc-96ed-f88ff4ae6a65 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:20:13.760451 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-4a46327b-f273-4afc-96ed-f88ff4ae6a65 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:20:13.766192 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4a46327b-f273-4afc-96ed-f88ff4ae6a65 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:20:13.766694 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4a46327b-f273-4afc-96ed-f88ff4ae6a65 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:20:13.767461 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4a46327b-f273-4afc-96ed-f88ff4ae6a65 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:20:13.767892 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-4a46327b-f273-4afc-96ed-f88ff4ae6a65 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:20:13.888615 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.policy [None req-4a46327b-f273-4afc-96ed-f88ff4ae6a65 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16afa61134d0457aa9f886c4bece5df2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2001cfaa564496ba271b544cfdc14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108417) authorize /opt/stack/nova/nova/policy.py:199}} Sep 02 17:20:13.905712 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-4a46327b-f273-4afc-96ed-f88ff4ae6a65 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 200 len: 1553 microversion: 2.1 time: 0.150067 Sep 02 17:20:13.906830 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 690/1443] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:20:13 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 02 17:20:14.346815 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [req-de8f3456-1800-445b-967c-5112c7a90587 req-aabd8eb9-87e6-4047-85a3-73ff3d94cd86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "371ab7f3-5976-495e-90cb-d0e9035d8eb1", "name": "network-vif-deleted", "tag": "31f557d1-9615-485b-967b-0c514ea54c30"}]} {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 02 17:20:14.348996 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 02 17:20:14.348996 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: warnings.warn(msg) Sep 02 17:20:14.357732 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-de8f3456-1800-445b-967c-5112c7a90587 req-aabd8eb9-87e6-4047-85a3-73ff3d94cd86 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:20:14.358223 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG oslo_concurrency.lockutils [req-de8f3456-1800-445b-967c-5112c7a90587 req-aabd8eb9-87e6-4047-85a3-73ff3d94cd86 service nova] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108418) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:20:14.370359 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.compute.server_external_events [req-de8f3456-1800-445b-967c-5112c7a90587 req-aabd8eb9-87e6-4047-85a3-73ff3d94cd86 service nova] Creating event network-vif-deleted:31f557d1-9615-485b-967b-0c514ea54c30 for instance 371ab7f3-5976-495e-90cb-d0e9035d8eb1 on hv-cinder-80626 Sep 02 17:20:14.376150 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [req-de8f3456-1800-445b-967c-5112c7a90587 req-aabd8eb9-87e6-4047-85a3-73ff3d94cd86 service nova] 10.222.0.41 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169523 Sep 02 17:20:14.376955 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 754/1444] 10.222.0.41 () {64 vars in 1318 bytes} [Thu Sep 2 17:20:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 02 17:20:14.922588 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-7f73743d-9018-4fcb-90c5-74e747bf1292 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '>' {{(pid=108417) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:20:14.923224 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.compute.api [None req-7f73743d-9018-4fcb-90c5-74e747bf1292 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] [instance: 371ab7f3-5976-495e-90cb-d0e9035d8eb1] Fetching instance by UUID {{(pid=108417) get /opt/stack/nova/nova/compute/api.py:2862}} Sep 02 17:20:14.929069 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7f73743d-9018-4fcb-90c5-74e747bf1292 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:20:14.929526 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7f73743d-9018-4fcb-90c5-74e747bf1292 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:20:14.930293 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7f73743d-9018-4fcb-90c5-74e747bf1292 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Sep 02 17:20:14.930776 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG oslo_concurrency.lockutils [None req-7f73743d-9018-4fcb-90c5-74e747bf1292 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Lock "3e42ac8c-9d05-40cd-947b-9719402da6b0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108417) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Sep 02 17:20:14.945090 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.wsgi [None req-7f73743d-9018-4fcb-90c5-74e747bf1292 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] HTTP exception thrown: Instance 371ab7f3-5976-495e-90cb-d0e9035d8eb1 could not be found. Sep 02 17:20:14.945869 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: DEBUG nova.api.openstack.wsgi [None req-7f73743d-9018-4fcb-90c5-74e747bf1292 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Returning 404 to user: Instance 371ab7f3-5976-495e-90cb-d0e9035d8eb1 could not be found. {{(pid=108417) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Sep 02 17:20:14.947053 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO nova.api.openstack.requestlog [None req-7f73743d-9018-4fcb-90c5-74e747bf1292 tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1" status: 404 len: 111 microversion: 2.1 time: 0.027944 Sep 02 17:20:14.947720 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: [pid: 108417|app: 0|req: 691/1445] 10.222.0.41 () {58 vars in 1236 bytes} [Thu Sep 2 17:20:14 2021] GET /compute/v2.1/servers/371ab7f3-5976-495e-90cb-d0e9035d8eb1 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 02 17:20:14.956799 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: DEBUG nova.api.openstack.wsgi [None req-80c0187a-fd20-4fed-92fc-4fd2d6dc0f5c tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] Calling method '.version_select at 0x7fca9d279550>' {{(pid=108418) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 02 17:20:14.974863 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO nova.api.openstack.requestlog [None req-80c0187a-fd20-4fed-92fc-4fd2d6dc0f5c tempest-TestMinimumBasicScenario-2082906375 tempest-TestMinimumBasicScenario-2082906375-project] 10.222.0.41 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-721833664" status: 202 len: 0 microversion: 2.1 time: 0.022293 Sep 02 17:20:14.975431 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: [pid: 108418|app: 0|req: 755/1446] 10.222.0.41 () {58 vars in 1269 bytes} [Thu Sep 2 17:20:14 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-721833664 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 02 17:20:22.476274 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 17:20:22.476807 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: Thu Sep 2 17:20:22 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 02 17:22:14.163809 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 17:22:14.164489 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: Thu Sep 2 17:22:14 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 02 17:23:42.500716 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 17:23:42.501295 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: Thu Sep 2 17:23:42 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 02 17:23:43.745573 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 17:23:43.746087 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: Thu Sep 2 17:23:43 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 02 17:25:31.089440 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 17:25:31.090120 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: Thu Sep 2 17:25:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 02 17:25:34.180981 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 17:25:34.181551 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: Thu Sep 2 17:25:34 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 02 17:25:46.338908 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 17:25:46.339461 dv-cinder-806260-3-iscsi devstack@n-api.service[108417]: Thu Sep 2 17:25:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Sep 02 17:25:47.602052 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 02 17:25:47.602487 dv-cinder-806260-3-iscsi devstack@n-api.service[108418]: Thu Sep 2 17:25:47 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!